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INTRODUCTION 


This  volume  Is  the  second  In  a  periodic  series  of  reports  of  current 
research  on  operator  workload.  As  in  any  highly  active  area  of  scientific 
Investigation,  progress  toward  the  understanding  of  mental  workload  is 
impeded  by  a  less  than  adequate  system  of  professional  communication. 
Lengthy  publication  delays,  the  wide  variety  of  journals  and  technical 
report  sources  In  which  workload  research  appears,  and  the  sheer  volume  of 
data  being  produced  substantially  detract  from  the  crucial  flow  of  informa¬ 
tion  among  scientists  and  users  of  workload  research.  These  problems  are 
ultimately  reflected  in  a  tendency  for  needless  duplication  of  effort  and  a 
reduction  in  the  efficiency  with  which  research  findings  are  translated  into 
equipment  design  and  training  solutions. 

The  Register  of  Research  in  Progress  on  Mental  Workload  was  conceived  as  one 
means  by  which  communication  and  cooperation  among  researchers  could  be 
improved.  Essentially,  the  register  is  intended  to  act  as  a  directory  to 
workload  scientists  and  their  projects.  For  a  second  year,  data  forms  were 
sent  to  individuals  selected  on  the  basis  of  known  previous  activity  in  the 
area.  Seventy-six  persons  currently  engaged  in  workload  research  contri¬ 
buted  responses.  The  information  provided  by  the  researchers  was  compiled 
along  with  the  data  obtained  in  the  1980  edition  to  produce  the  six  sections 
comprising  the  1982  register. 

The  first  two  sections  provide  a  name  index  and  a  list  of  key  terms  which 
may  be  used  to  facilitate  access  to  more  specific  information  on  individual 
research  efforts.  The  third  section  contains  data  on  each  researcher's 
affiliation,  mailing  address,  and  telephone  number.  In  addition,  each  entry 
is  accompanied  by  current  project  descriptions  provided  by  the  respondent. 
The  fourth  section  is  a  listing  of  laboratories  engaged  in  workload 
research.  The  final  two  sections  contain  general  information  deemed  to  be 
of  possible  use  to  both  present  and  future  researchers  in  the  area.  The 
fifth  section  lists  organizations  which,  according  to  the  respondents,  have 
interests  in  workload  research  and  may  be  sources  of  funding  for  such 
efforts.  The  sixth  section  contains  responses  to  a  request  to  list  those 
publications,  reports,  and  books  which  have  made  the  most  significant  con¬ 
tributions  to  the  understanding  of  mental  workload. 

Present  plans  call  for  the  register  to  be  updated  and  published  on  a  semi¬ 
annual  basis.  Comments  on  the  format  of  the  register,  potential  improve¬ 
ments,  and  suggestions  concerning  the  inclusion  of  significant  research 
efforts  not  represented  in  this  edition  are  welcomed.  Please  address  any 
correspondence  to: 

Thomas  Metzler 

U.S.  Army  Aviation  Research  and  Development  Command 

DRDAV-DM 

4300  Goodfellow  Boulevard 

St.  Louis,  Missouri  63120 
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SECTION  II 


KEYTERM  INDEX 


A  fixed  list  of  keytenns  was  provided  on  the  data  form.  Respondents  are 
listed  under  all  keytenns  which  they  Indicated  as  being  descriptive  of  their 
research  interests. 
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O'Donnell,  Robert  D. 
Schiflett,  Sam  G. 
Senders,  John  W. 
Sheridan,  Thomas  B. 
Siegel,  Arthur  I. 

Soede,  Mathijs 
Wlerwllle,  Walter  W. 
Wlckens,  Christopher  D. 

Discrete  Secondary  Tasks 

Allulsl,  Earl  A. 

Brown,  Ivan 
Butterbaugh,  Larry  C. 
Colie,  Herbert  A. 
Crabtree,  Mark  S. 
Crawford,  Billy  M. 
Damos,  Diane  L. 

Dunn,  Richard  S. 
Ephrath,  Arye  R. 
Fregley,  Alfred  R. 
Gabriel ,  Richard  F. 
Gomer,  Frank  E. 

Gopher,  Daniel 
Griffith,  Douglas 
Harris,  Sr.,  Randall  L. 
Hart,  Sandra  G. 

Jex,  Henry  R. 

Johannsen,  Gunnar 
Kantowltz,  Barry  H. 
Kennedy,  Robert  S. 
Levine,  Jerrold  M. 
Mertens,  Henry  W. 

Moray,  Neville  P. 
Morgan,  Jr.,  Ben  B. 
Mulder,  G. 

North,  Robert  A. 
O'Donnell,  Robert  D. 
Pflendler,  Claudius 
Schiflett,  Sam  G. 
Senders,  John  W. 
Sheridan,  Thomas  B. 
Shlngledecker,  Clark  A. 
Soede,  Mathijs 
Tole,  John  R. 

Wlerwllle,  Walter  W. 

Alternative  Assessment  Techniques 

Ephrath,  Arye  R. 
Fregley,  Alfred  R. 
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Gomer,  Frank  E. 

Jex,  Henry  R. 

Murphy,  Miles  R. 
O'Donnell,  Robert  D. 
Parks,  Donald  L. 

Sanders,  A.  F. 

Schiflett,  Sam  G. 

Senders,  John  W. 
Shlngledecker,  Clark  A. 
Wlerwllle,  Walter  W. 

Analytical  Workload  Estimation 

Borg,  Gunnar 
Brlctson,  Clyde  A. 
Butterbaugh,  Larry  C. 
Crabtree,  Mark  S. 

Donnell,  Michael  L. 

Dunn,  Richard  S. 

Edwards,  Richard  E. 
Fregley,  Alfred  R. 

Gabriel ,  Richard  F. 
Gerathewohl,  Siegfried  0. 
Gopher,  Daniel 
Hopkln,  V.  David 
Jahns,  Dieter  W. 

Jex,  Henry  R. 

Lane,  Norman  E. 

Levine,  Jerrold  M. 
Levlson,  William  H. 
Linton,  Paul  M. 

Molesko,  Norman  M. 

Moray,  Neville  P. 

Murphy,  Miles  R. 

Navon,  David 
O'Donnell,  Robert  D. 
Parks,  Donald  L. 

Qualy,  Judl 
Rohmert,  Walter 
Schiflett,  Sam  G. 

Senders,  John  W. 
Shlngledecker,  Clark  A. 
Siegel,  Arthur  I. 

Soede,  Mathljs 
Wlckens,  Christopher  D. 

Scaling 

Borg,  Gunnar 
Brlctson,  Clyde  A. 
Butterbaugh,  Larry  C. 
Colle,  Herbert  A. 


Crabtree,  Hark  S. 
Donnell,  Michael  L. 
Gopher,  Daniel 
Helm,  Wade  R. 

Hopkln,  Y.  David 
Jex,  Henry  R< 

Kennedy,  Robert  S. 

Lane,  Norman  E. 

Linton,  Paul  M. 

Molesko,  Norman  M. 
Moray,  Neville  P. 

Navon,  David 
O’Donnell,  Robert  D. 
Parks,  Donald  L. 

Reid,  Gary  B. 

Sheridan,  Thomas  B. 
Shlngledecker,  Clark  A. 
Siegel,  Arthur  I. 
Wlckens,  Christopher  D. 

Validation  Research 

Borg,  Gunnar 
Brlctson,  Clyde  A. 
Butterbaugh,  Larry  C. 
Crabtree,  Mark  S. 
Crawford,  Billy  M. 
Donnell,  Michael  L. 
Dunn,  Richard  S. 
Fregley,  Alfred  R. 
Gomer,  Frank  E. 

Gopher,  Daniel 
Harris,  Sr.,  Randall  L. 
Hopkln,  V.  David 
Jahns,  Dieter  W. 

Oex,  Henry  R. 

Johannsen,  Gunnar 
Kennedy,  Robert  S. 

Lane,  Norman  E. 

Linton,  Paul  M. 

Moray,  Neville  P. 
Mulder,  G. 

O'Donnell,  Robert  D. 
Parks,  Donald  L. 
Pflendler,  Claudius 
Qualy,  Judl 
Rasmussen,  Jens 
Reid,  Gary  B. 

Rohmert,  Walter 
Schlflett,  Sam  G. 
Wlerwllle,  Walter  W. 
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Aircraft  Systems 

Alluisl ,  Earl  A. 

Brlctson,  Clyde  A. 
Butterbaugh,  Larry  C. 
Christensen,  Jullen  M. 
Crabtree,  Hark  S. 

Donnell,  Michael  L. 

Dunn,  Richard  S. 

Edwards,  Richard  E. 
Eggemeler,  F.  Thomas 
Ephrath,  Arye  R. 

Fregley,  Alfred  R. 
Gabriel,  Richard  F. 
Gerathewohl ,  Siegfried  J. 
Gomer,  Frank  E. 

Gopher,  Daniel 
Gunning,  David  R. 

Harris,  Sr.,  Randall  L. 
Hart,  Sandra  G. 

Helm,  Wade  R. 

Hopkln,  V.  David 
Jahns,  Dieter  W. 

Jex,  Henry  R. 

Johannsen,  Gunnar 
Kennedy,  Robert  S. 

Lane,  Norman  E. 

Levlson,  William  H. 
Linton,  Paul  M. 

Holesko,  Norman  M. 

Moray,  Neville  P. 

Murphy,  Miles  R. 

North,  Robert  A. 
O'Donnell,  Robert  D. 
Parks,  Donald  L. 
Pflendler,  Claudius 
Qualy,  Judl 
Reid,  Gary  B. 

Roscoe,  Alan  H. 

Rouse,  William  B. 
Schlflett,  Sam  6. 
Sheridan,  Thomas  B. 
Shlngledecker,  Clark  A. 
Thlessen,  Mary  S. 

Tole,  John  R. 

Wlerwllle,  Walter  W. 

Surface  Transport  Systems 

Borg,  Gunnar 
Jex,  Henry  R. 

Johannsen,  Gunnar 
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Kennedy,  Robert  S. 
O'Donnell,  Robert  D. 
Pflendler,  Claudius 
Rohmer t,  Walter 
Wlerwllle,  Walter  W. 


Naval  Systems 


Brictson,  Clyde  A. 
Christensen,  Julien  M. 
Donnell,  Michael  L. 

Gabriel,  Richard  F. 

Helm,  Wade  R. 

Jex,  Henry  R. 

Kennedy,  Robert  S. 

Lane,  Norman  E. 

Linton,  Paul  M. 

Mulder,  G. 

Sanders,  A.  F. 

Sanders,  Mark  S. 

Schlflett,  Sam  G. 

Sheridan,  Thomas  B. 

Siegel,  Arthur  I. 

Command  Control  ar.d  Communications  Systems 

Allulsl,  Earl  A. 
Butterbaugh,  Larry  C. 
Christensen,  Julien  M. 
Crawford,  Billy  M. 

Ephrath,  Arye  R. 

Fregley,  Alfred  R. 

Gabriel ,  Richard  F. 
Goldbeck,  Robert  A. 

Gomer,  Frank  E. 

Gopher,  Daniel 
Hopkln,  V.  David 
Johnson,  Edgar  M. 

Lane,  Norman  E. 

Levine,  Jerrold  M. 

Linton,  Paul  M. 

Moray,  Neville  P. 

O'Donnell,  Robert  D. 

Parks,  Donald  L. 

Rohmert,  Walter 
Sheridan,  Thomas  B. 
Shlngledecker,  Clark  A. 

Industrial  Systems 

Borg,  Gunner 
Brown,  Ivan 
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Christensen,  Jullen  M. 
Gabriel,  Richard  F. 
Gopher,  Daniel 
Hopkln,  V.  David 
Moray,  Neville  P. 
North,  Robert  A. 
Rasmussen,  Jens 
Rohnert,  Walter 
Sanders,  Mark  S. 


Weapons  Systems 


Brlctson,  Clyde  A. 
Butterbaugh,  Larry  C. 
Christensen,  Jullen  M. 
Crabtree,  Mark  S. 
Crawford,  Billy  M. 
Donnell,  Michael  L. 
Fregley,  Alfred  R. 
Gabriel,  Richard  F. 
Gomer,  Frank  E. 

Gopher,  Daniel 
Jahns,  Dieter  W. 

Jex,  Henry  R. 

Lane,  Norman  E. 

Linton,  Paul  M. 

North,  Robert  A. 
O'Donnell,  Robert  D. 
Parks,  Donald  L. 

Qualy,  Judl 
Schiflett,  Sam  G. 


Section  III 
CURRENT  PROJECTS 

This  section  contains  an  alphabetically  arranged  list  of  researchers.  Each 
entry  Includes  the  researcher's  primary  organizational  affiliation, 
address,  and  telephone  number,  and  Is  accompanied  by  brief  descriptions  of 
one  or  more  current  mental  workload  research  activities  of  the  respondent. 
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Alluisi,  Earl  A. 

Chief  Scientist 
AFHRL/CCN 

Brooks  AFB,  Texas  78235 

i':..  (512)  536-3605  (AUTOVAN  240-3605) 

STRESS  AND  PERFORMANCE  IN  THE  FLYING  TRAINING  ENVIRONMENT 

The  objective  is  to  investigate  stress  in  the  flying  training  environment 
with  particular  interest  directed  to  stress  of  simulated  flight  and  sub¬ 
sequent  stress  of  airborne  events.  Experiments  have  been  planned  which 
(1)  allow  for  quantification  of  stress  experienced  in  various  modes  and 
phases  of  surface  attack  training,  (2)  help  determine  the  interaction  of 
instructor  techniques  and  student  stress,  and  (3)  provide  a  clearer  picture 
of  the  relationship  between  stress,  learning,  and  performance  in  surface 
attack  training. 

Three  studies  will  examine  (1)  physiological  indices  of  stress  in  A-10 
surface  attack  training,  (2)  the  effect  of  IP  teaching  style  on  student 
stress,  and  (3)  the  effect  of  combat  experience  on  stress  response  to  simu¬ 
lated  A-10  scenarios. 

STRESS  UTILIZATION/REDUCTION  IN  FLYING  TRAININ6 

Previous  research  established  the  utility  of  catecholamine  excretion  as  a 
metric  to  assess  stress  in  pilot  training.  The  objective  of  the  present 
work  unit  is  to  determine  patterns  of  stress  response  in  pilots  exposed  to 
varying  levels  of  workload/stress  in  both  aircraft  and  simulated  flight 
scenarios. 

Four  experiments  will  be  conducted,  each  of  which  will  assess  patterns  of 
stress  response  as  indicated  by  a  selected  set  of  hormones,  neurotransmit¬ 
ters,  and  their  metabolities.  Urinalysis  will  be  employed.  These  experi¬ 
ments  address  (1)  stress  response  of  pilots  in  simulated  high  threat  envi¬ 
ronments,  (2)  relationship  of  psychophysiol ogical  and  biochemical  stress 
responses,  (3)  biochemical  response  profiles  to  different  stressors,  and 
(4)  stress  in  flight  line  emergencies. 

ASSESSMENT  OF  WORKLOAD  AND  PREDICTION  OF 
PERFORMANCE  BY  COMBINED  TECHNIQUES 

The  objective  is  to  develop  and  Implement  combined  behavioral  and  psycho- 
physiological  techniques  for  measuring  pilot  attention  and  task  load  during 
flight  simulation.  Ultimately  these  combined  techniques  will  be  used  to 
optimally  structure  flight  simulation  training  programs  and  equipment. 

A  series  of  laboratory  studies  will  be  conducted  in  order  to  effectively 
develop  and  refine  the  combined  psychophysiological  and  behavioral  measures. 
These  studies  will  use  a  simplified  flight  simulation  type  behavioral  task 
with  task  difficulty  varying  as  a  function  of  primary  and  secondary  task 
difficulty. 
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A  series  of  related  flight  simulation  studies  at  AFHRL  will  also  be 
conducted  In  order  to  transfer  the  laboratory  findings  to  the  flight  simu¬ 
lation  environment. 

AIRCREW  PERFORMANCE  ASSESSMENT  SYSTEM  FOR  THE  C-5  SIMULATOR 


The  objective  Is  to  develop  and  Implement  an  aircrew  performance  assessment 
system  for  the  C-5  flight  simulator.  The  performance  measurement  system 
shall  provide  a  means  by  which  valid,  reliable,  objective/quantitative  mis¬ 
sion  performance  data  may  be  obtained  for  C-5  aircrew  members.  These  per¬ 
formance  data  shall  be  obtained  for  all  mission  essentlal/crltlcal  perform¬ 
ance  Items.  The  system  as  specified  shall  constitute  a  feasibility  demon¬ 
stration  or  experimental  prototype  model.  As  such.  It  shall  provide  a  means 
for  exploring  alternative  performance  measurement  strategies  and  determining 
the  relationship  between  measured  performance  In  the  simulator  and  the 
aircraft. 


Borg,  Gunnar 

PTI-Unlt,  Psykologlska  Instltutlonen 
University  of  Stockholm 
Box  5602,  Flskartorpsvagen  15 
Stockholm,  Sweden  S-114  86 
Ph.  08/22  32  20 

SUBJECTIVE  ASPECTS  OF  PHYSICAL  AND  MENTAL  LOAD 

During  the  past  20  years,  we  have  been  carrying  out  stud^s  on  various 
subjective  aspects  of  workload.  Most  of  the  studies  have  concerned  per¬ 
formance  of,  and  perceptual  responses  to,  heavy  physical  work,  although 
subjective  effort  and  difficulty  perceived  during  mental  tasks  have  also 
been  dealt  with.  We  have  been  using  three  different  kinds  of  stress  indi¬ 
cators  or  "effort  variables":  perceptual,  performance,  and  physiological, 
which  compliment  one  another.  To  arrive  at  a  full  understanding  of  man  at 
work,  we  must  study  subjectively  perceived  differences  not  only  over  the 
whole  range  of  working  conditions,  but  also  In  relation  to  preferred  Inten¬ 
sities  of  effort,  adaptation  levels,  stress  conditions,  etc.,  and  observe 
how  subjective  changes  at  these  levels  are  related  to  performance,  physio¬ 
logical  Indicators,  and  measurements  of  working  capacity  (Borg,  1971). 
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Brictson,  Clyde  A. 

Dunlap  and  Associates,  Inc. 

Western  Division 
920  Kline  Street,  Suite  203 
La  Jolla,  California  92037 
Ph.  (714)  459-3377 

METHODS  TO  ASSESS  PILOT  WORKLOAD  AND  OTHER  TEMPORAL 
INDICATORS  OF  PILOT  PERFORMANCE  EFFECTIVENESS 

A  systematic  approach  to  define,  measure,  and  describe  how  certain  pilot- 
related  variables  influence  carrier  landing  performance  during  sustained 
operations  Is  briefly  outlined.  Previous  exploratory  research  on  the  inter¬ 
relations  between  psychophyslologlcal  variables,  pilot  experience,  and  per¬ 
formance  Is  described.  Pilot  work  activity,  mood,  and  sleep  are  identified 
as  Indicators  of  a  pilot's  temporal  state  of  readiness.  A  field  study 
design  and  techniques  to  measure  and  describe  temporal  readiness  during 
prolonged  flight  operations  are  provided  to  demonstrate  the  methodology  in 
an  operational  environment.  Potential  applications  of  the  research  are 
discussed  along  with  the  future  role  of  temporal,  psychological,  and  other 
moderator  variables  In  estimating  pilot  flight  status. 

AIRCREW  PERFORMANCE  RESEARCH  OPPORTUNITIES  USING 
THE  AIR  COMBAT  MANEUVERING  RANGE  (ACMR) 

Three  years  of  aircrew  performance  measurement  related  to  air  combat 
effectiveness  using  the  Navy's  Air  Combat  Maneuvering  Range  (ACMR)  are  pre¬ 
sented  as  evidence  of  ACMR's  research  potential.  Performance  assessment 
methods  used  to  evaluate  pilot  proficiency  are  described.  The  aircrew 
assessment  methods  have  been  used  to  Identify  squadron  performance  differ¬ 
ences,  evaluate  competitive  exercises,  and  provide  diagnostic  training  feed¬ 
back  to  operational  users.  The  use  of  continuously  recorded  quantitative 
measures  from  systems  such  as  ACMR  should  stimulate  more  aircrew  performance 
field  research  ideas.  The  availability  of  objective  performance  criteria 
promises  to  be  of  substantial  benefit  to  both  the  operational  user  and  the 
research  community  In  such  areas  as  pilot  selection  and  training,  fleet 
combat  readiness,  and  pilot  workload  and  stress. 

PREDICTION  OF  PILOT  PERFORMANCE:  BIOCHEMICAL  AND 
SLEEP-MOOD  CORRELATES  UNDER  HIGH  WORKLOAD  CONDITIONS 

A  preliminary  study  of  pilot  performance,  blood  chemistry,  and  sleep/mood 
patterns  during  prolonged  periods  of  carrier  operations  indicated  that 
changes  In  pilot  metabolism  and  subjective  moods  can  be  related  to  varia¬ 
tions  in  pilot  landing  performance.  A  statistically  significant  multiple  R 
of  .81  (n  -26,  p  F  .01)  was  obtained  with  four  predictors.  In  a  separate 
study,  pilot  sleep  patterns  for  a  one-week  period  were  related  to  landing 
performance  scores.  Pilot  Intersleep  Intervals  were  highly  correlated  with 
day  landing  performance  and  found  to  be  significantly  different  than  those 
of  nonflying  personnel . 
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MEASURES  OF  PILOTS'  TEMPORAL  STATES  OF  READINESS 


This  research  follows  up  previous  results  with  more  refined  data  collection 
procedures  and  instruments  and  integrates  measures  of  a  pilot's  temporal 
state  of  readiness  (sleep,  mood,  workload)  with  other  pilot  centered  meas¬ 
ures.  Studies  of  two  stress  environments  were  undertaken:  (a)  carrier 
deployment,  and  (b)  carrier  landing  qualification  (CQ).  Pilots  from  three 
attack  squadrons  embarked  on  the  USS  Kennedy  (CV-67)  during  a  recent  Medi¬ 
terranean  deployment  were  the  subjects  for  Phase  1  of  the  research  program. 
Data  were  collected  on  daily  activities  for  three  major  periods  of  time:  a 
baseline  nonflying  period;  a  follow-up  normal  flying  period;  and  a  72-hour 
high  workload  period  of  continuous  flight  operations.  Daily  activity  data 
on  pilot  workload  (flying  and  administrative)  sleeping,  eating,  exercise, 
and  mood  as  well  as  pilot  landing  performance  for  the  entire  cruise  were 
collected  and  analyzed.  Findings  of  Interest  indicate  that  pilot  workload 
averaged  13  hours  per  day  with  57  percent  of  the  time  spent  on  flight- 
related  activities.  When  flying  Increased,  squadron  administrative  work  was 
reduced  proportionally.  No  group  sleep  pattern  disruptions  were  noted 
although  sleep  duration  rose  as  flight  activity  increased.  More  short  sleep 
episodes  (naps)  during  flight  periods  account  for  this  increase.  Perform¬ 
ance  findings  were  remarkable  for  their  consistent  high  levels,  especially 
in  terms  of  night  carrier  landing  performance. 

Brown,  Ivan 

Applied  Psychology  Unit 
Medical  Research  Council 
15  Chaucer  Road 
Cambridge,  England  CB22EF 
Ph.  0223  355294 

SOME  EFFECTS  OF  TASK  AND  WORKSPACE  DESI6N 
TRENDS  ON  CORRELATES  OF  JOB  SATISFACTION 
AMONG  TELEPHONE  SWITCHBOARD  OPERATORS 

Operators  of  cordless  switchboards  report  dissatisfaction  with  their  job  and 
perform  less  efficiently  than  operators  of  cord  boards.  To  explore  possible 
causal  factors,  15  operators  participated  in  a  psychophysiologlcal  study  of 
both  working  conditions.  Cord  operators  were  found:  (a)  to  carry  a  con¬ 
sistently  heavier  workload  of  concurrent  calls;  (b)  to  be  dramatically  more 
responsive  to  diurnal  fluctuations  in  call-traffic  level,  while  maintaining 
more  stable  "caller  waiting  times"  and  "effective  call  connections";  (c)  to 
exhibit  this  advantage  without  displaying  higher  levels  of  physiological 
stress;  and  (d)  to  display  consistently  higher  levels  of  psychological  well 
being.  It  Is  concluded  that  the  cord  operators'  greater  job  satisfaction 
derives  mainly  from  the  substantial  advantages  their  flexible  system  pro¬ 
vides  them  in  attaining  and  maintaining  a  high  quality  service. 
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Butterbaugh,  Larry  C. 

AFWAL/FIGR 

Wright-Patterson  AFB,  Ohio  45433 
Ph.  (513)  255-6931 

WORKLOAD  PROBLEM  ASSESSMENT 

The  Air  Force  function  for  this  effort  is  to  research  operational  aircrew 
workload  and  advanced  methods  for  assessing  the  workload  expected  in  future 
vehicles.  A  problem  has  occurred  due  to  the  neglect  in  developing  assess¬ 
ment  methods  which  are  sensitive  to  workloads  in  advanced  control  and  dis¬ 
play  systems.  The  objective  Is  to  maintain  familiarity  with  workload 
assessment  technology,  to  have  total  awareness  and  understanding  of  current 
operational  workload  problems,  and  to  study  innovative  workload  assessment 
methods  for  their  applicability  to  crew  systems  engineering.  This  effort 
will  contribute  knowledge  needed  to  fully  understand  operational  workload 
problems  such  that  the  crew  systems  Interface  areas  requiring  further  study 
can  be  Identified.  Operational  crews  from  the  major  commands  were  inter¬ 
viewed  In  FY80  and  workload  related  flight  problems  identified.  A  data  base 
of  operational  workload  problems  was  created  In  order  to  Identify  crew 
system  problems  that  should  be  addressed  in  the  development  of  future 
vehicles.  As  a  result  of  this  work  effort,  existing  workload  problems  are 
Identified  for  existing  system  operation,  allowing  for  their  study  and  reso¬ 
lution  prior  to  their  repetition  in  future  systems  (AFWAL-TR-80-3011) .  Such 
Insight  Into  current  workload  problems  and  the  awareness  of  Improved  work¬ 
load  assessment  methods  will  result  In  better  and  more  cost-effective 
methods  of  evaluating  crew  workload  as  part  of  the  crew  systems  development 
process.  This  work  effort  has  been  completed. 

CREW  SYSTEM  DESIGN  AND  EVALUATION  METHODOLOGY 

The  Air  Force  function  supported  by  this  work  effort  Is  the  research  and 
development  of  the  crew  system  Interface  for  advanced  airborne  weapon 
systems.  As  aircraft  missions  have  become  more  complex,  so  has  the  crew- 
station  design.  The  point  has  been  reached  where  the  crew  system  interface 
and  Its  optimization  can  significantly  Impact  the  pilot's  ability.  This 
means  the  crewstatlon  must  be  designed  as  an  integral  unit  and  that  a 
variety  of  design  evaluations  are  necessary  to  assume  the  design  Is  opti¬ 
mized.  In  other  words,  the  total  evaluation  must  address  all  the  Issues 
(e.g.,  workload,  reliability,  performance,  fatigue,  task  allocation,  etc.), 
not  just  one  or  two.  The  objective  Is  to  establish  and  maintain  an  aware¬ 
ness  of  the  complexity  of  total  crew  system  design  and  evaluation  and  to 
become  familiar  with  methods  that  exist  throughout  the  RAD  community,  and  to 
study  Innovative  evaluation  methods  for  their  applicability  to  the  crew 
system  engineering  process.  This  In-house  effort  will  consist  of  literature 
reviews  and  data  base  searches  In  order  to  document  the  range  of  design  and 
evaluation  methods,  their  constraints  for  application,  and  their  value  as  a 
design  or  evaluation  tool.  The  crew  system  engineering  process  will  be 
documented  In  TR  format  In  FY81.  Periodic,  regular  communications  will 
occur  with  other  DoD  organizations  In  the  area  of  crewstatlon  evaluation 
techniques.  As  a  result  of  this  work  effort,  USAF  weapon  systems  will  be 
more  fully  evaluated  from  the  position  of  the  crew  system  Interface.  By 


Identifying  the  range  of  design  Issues  and  methods  by  which  to  resolve  them, 
better  and  more  cost-effective  evaluations  can  occur. 

TAACE  WORKLOAD  PREDICTION 

This  contracted  effort  applied  an  analytic  method  known  as  the  Controls  and 
Displays  Evaluation  Model  (CODEM)  to  flight  deck  avionics  Improvements  which 
resulted  from  AFWAL/FIGR's  Tanker  Avionics  and  Aircrew  Complement  Evaluation 
(TAACE)  Program.  Specifically,  CODEM  was  used  to  evaluate  the  capability  of 
the  TAACE  Improvements  to  perform  the  Rendezvous  and  In-Flight  Refueling 
segments  of  the  KC-135  mission.  (TAACE  data  were  utilized  because  the  under¬ 
lying  intent  of  this  contract  was  to  apply  CODEM  to  a  previously,  independ¬ 
ently  evaluated  design  for  the  purpose  of  validating  the  CODEM  concept  and 
sensitivity.  This  evaluation  will  occur  Independent  from  this  effort.) 

TAACE,  which  supported  the  USAF  KN-135  Modernization  Program,  sought  to 
establish  the  design  criteria  for  the  controls  and  displays  of  the  Improved 
flight  deck  avionics  In  the  event  the  crew  of  the  KN-135  Is  reduced  by 
eliminating  the  navigator.  The  study  involved  the  analysis  of  the  new 
flight  deck  hardware  designed  for  the  KN-135;  the  application  of  Northrop 's 
CODEM  program  to  generated  crew  task  complexity,  or  workload,  profiles,  and 
the  Identification  and  validation  of  changes  which,  according  to  the  pro¬ 
files,  would  further  reduce  the  crew's  workload. 

The  CODEM  results  Indicated  that  the  flight  deck  of  the  modernized  KC-135 
aircraft  can  be  operated  satisfactorily  in  the  Rendezvous  and  In-Flight 
Refueling  segment  of  a  tanker  mission  with  only  a  pilot  and  a  copilot.  The 
study  also  established  that,  on  the  basis  of  the  CODEM  analysis,  the  new 
flight  deck  avionics  equipment  elements  did  not  cause  unacceptably  high  crew 
workloads  during  the  mission  segment  studied.  The  technical  work  has  been 
completed  and  a  Technical  Report  Is  being  processed  for  publication. 

Carter,  Richard  J. 

USA  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
Fort  Bliss  Field  Unit 
Fort  Bliss,  Texas 

DEVELOPMENT  OF  A  SHORT-RANGE  AIR  DEFENSE  SIMULATION 
FACILITY  AND  A  CREWMAN  PERFORMANCE  DATA  BASE 

BACKGROUND 

Studies  are  currently  being  undertaken  to  establish  air  defense  command  and 
control  system  requirements  essential  to  the  accompli shment  of  the  air 
defense  mission  and  to  evaluate  equipment  performance  and  doctrinal  con¬ 
cepts.  An  Important,  critical  part  of  the  above  system  requirements  Is 
Information  concerning  Short-Range  Air  Defense  (SHORAD)  weapon  system  per¬ 
sonnel  detection  and  recognition  capabilities.  This  Information  is,  how¬ 
ever,  difficult  to  obtain  because  of  the  high  cost  of  live  aircraft  support 
and  of  the  nonavailability  of  foreign  aircraft. 
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During  the  Interval  of  1964  through  1976,  research  aimed  at  developing  a 
data  bank  concerning  the  capabilities  of  operators  of  forward  area  air 
defense  weapons  to  detect.  Identify,  and  estimate  the  distance  of  low-flying 
aircraft  was  conducted.  The  studies  had  to  be  conducted,  however.  In  a 
part-task  evaluation  environment.  That  Is,  each  of  these  critical  tasks  was 
studied  In  Isolation  from  the  other  components  of  the  total  operational 
sequence.  Part-task  research  only  was  conducted  because  techniques  for 
measuring  the  effectiveness  of  the  total  engagement  sequence  were  not  eco¬ 
nomically  feasible.  As  a  result,  there  Is  a  lack  of  Information  concerning 
an  operator's  abilities  In  performing  part-task  components  when  they  are 
embedded  In  whole- task  performance  requirements. 

RESEARCH 

The  Army  Research  Institute  has  Initiated  a  research  program  oriented  toward 
the  development  of  a  facility  which  realistically  simulates  the  SHORAD 
engagement  environment  and  the  generation  of  a  data  bank  of  Information 
concerning  operator  performance. 

Past  Research 


The  effort  thus  far  has  consisted  of  a  paper-and-pencll  feasibility  study  of 
the  applicability  of  low-cost  simulation  for  presenting  the  SHORAD  environ¬ 
ment.  In  Task  1,  parameters  which  must  be  Included  in  the  simulation  of  the 
SHORAD  engagement  environment  were  Identified.  During  Task  2,  low-cost 
simulation  approaches  were  evaluated  for  their  relevance  for  the  SHORAD 
environment.  Three  sets  of  data  that  will  be  necessary  to  collect  when 
assessing  operator  performance  capabilities  were  Identified  in  Task  3. 
Instrumentation  to  gather  data  was  also  detailed. 

Present  Research 


The  present  research  effort  will  occur  over  the  course  of  three  years. 
Year  1  research  Is  directed  at  fabricating  a  scaled  dynamic  flying  model 
aircraft  facility  and  evaluating  the  validity  of  the  simulation.  The  orien¬ 
tation  of  the  research  in  Year  2  will  be  primarily  to  gather  baseline  data. 
Year  3  research  will  have  the  main  purpose  of  Investigating  the  effects  of 
cueing  and  early  warning  on  detection  and  recognition. 

Colle,  Herbert  A. 

Department  of  Psychology 
Wright  State  University 
Dayton,  Ohio  45435 
Ph.  (513)  873-2363 

DEVELOPMENT  OF  ADDITIVE  WORKLOAD  SCALES 

Fundamental  Measurement  theory  Is  being  applied  to  develop  additive  scales 
of  mental  workload.  A  technique  has  been  developed  to  equate  the  workload 
of  different  types  of  tasks  without  making  arbitrary  scaling  assumptions 
about  the  relationship  between  task  performance  and  mental  workload.  The 
additivity  assumption  Is  being  tested  both  In  a  secondary  task  framework 
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and  In  a  subjective  scaling  framework.  Currently,  a  battery  of  tasks  Is 
being  evaluated. 

Courtrlght,  John  F.,  Ph.D. 

Acting  Chief,  Crew  Performance  Branch 
USAF  School  of  Aerospace  Medicine 
Brooks  AFB,  Texas  78235 

Ph.  (512)  536-3811/3465,  (AUTOVON  785-3811/3465) 

SUMMARY  OF  0N-60ING  RESEARCH 

The  major  focus  of  attention  for  both  basic  research  and  exploratory 
development  for  the  Crew  Performance  Branch  Is  aimed  at  developing  and 
applying  means  to  assess  the  stress,  fatigue,  and  workload  effects  on  crew 
performance  In  adverse  operational  conditions  and  environments.  Both  In- 
house  and  contract  activities  are  Involved.  The  basic  research  efforts  are 
performed  as  a  part  of  the  program  of  the  Air  Force  Office  of  Scientific 
Research.  The  exploratory  development  activities  are  being  undertaken  In 
concert  with  the  Workload  and  Erognomlcs  Branch  of  the  Air  Force  Aerospace 
Medical  Research  Laboratory,  Wrlght-Patterson  AFB,  Ohio. 

Current  efforts  Include  development  of  subjective  self-report  scales  of 
perceived  operator  fatigue  for  aircrew  and  groundcrew;  subjective  self- 
report  scales  of  perceived  operator  anxiety  states;  electrophyslologlcal 
techniques  for  the  assessment  of  attention  lapses  associated  with  changes  of 
alertness  for  aircrew;  electrocardiographic  techniques  for  In-flight  assess¬ 
ment  of  pilot  workload;  and  methods  for  assessing  the  field  applicability  of 
various  promising  laboratory  methods  of  assessing  workload  presently  under 
development  at  the  Air  Force  Aerospace  Medical  Research  Laboratory.  Basic 
research  efforts  are  presently  directed  towards  examination  of  the  com¬ 
ponents  of  complex  decision-making  tasks  for  their  Individual  component 
susceptibility  to  the  effects  of  stressors  associated  with  varying  demand 
schedules  and  unusual  work/rest  schedules;  development  of  metrics  based  on 
eye-blink  and  eye  movement  which  can  be  used  to  Index  lapses  In  operator 
attention  and  the  onset  of  fatigue  likely  to  effect  decision-making  and 
Information  processing  of  the  type  required  In  the  operation  of  military 
aircraft;  examination  of  the  potential  for  time  series  analysis  of  electro¬ 
encephalogram  and  electroculogram  data  for  Indexing  a  pilot's  ability  to 
perform  Information  processing  and  decision-making,  particularly  as  It  Is 
effected  by  repeated  sorties  within  a  given  day;  and  examination  of  the 
potential  of  sequential  optimal  control  models  for  becoming  a  means  to  Index 
piloting  behavior  In  the  presence  of  high  cognitive  processing  workload 
demand  under  conditions  of  repeated  missions  In  a  single  day. 


Crabtree,  Nark  S. 
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COMMUNICATIONS  WORKLOAD  PROJECT 

Most  workload  assessment  techniques  suffer  from  a  number  of  shortcomings 
that  can  be  attributed  to  the  lack  of  validity  and  reliability  data  associ¬ 
ated  with  the  techniques,  possible  difficulties  In  directly  measuring  mental 
events,  lack  of  operational  applicability,  the  need  for  additional  equipment 
In  space-limited  environments,  and  a  variety  of  other  Ills.  Even  secondary 
tasks,  which  are  the  most  widely  used  methodology  for  objective  measurement 
of  workload,  are  often  Intrusive,  unrealistic,  and  poorly  accepted  by 
pilots.  A  means  for  overcoming  these  difficulties  may  be  found  In  a  task 
that  Is  Imbedded  In  other  activities  that  are  already  a  part  of  the  opera¬ 
tor's  normal  duties.  Radio  communications  activities  appear  to  be  amenable 
to  such  application  because  they  embody  many  properties  of  a  good  workload 
measure.  Information  theoretical  analysis  and  pilot  opinions  Indicate  that 
communications  activity  can  be  broken  down  Into  Individual  tasks  with  speci¬ 
fiable  levels  of  workload.  The  results  of  a  simulation  study  Indicate  that 
human  performance  on  certain  communications  tasks  Is  Indeed  sensitive  to 
primary  task  difficulty.  Future  efforts  will  be  directed  toward  the  valida¬ 
tion  of  these  results  In  high  fidelity  simulations.  The  ultimate  goal  of 
the  communications  workload  project  is  the  development  of  a  standardized  set 
of  communications  tasks  that  can  be  used  as  embedded  secondary  tasks  for 
workload  assessment  at  all  stages  of  system  evolution. 

SECONDARY  TASK  DEVELOPMENT  PROJECT 

Some  secondary  tasks  may  be  more  sensitive  than  other  secondary  tasks  to  the 
workload  Imposed  by  specific  primary  tasks.  It  Is  possible  that  secondary 
tasks  which  share  the  same  mental  capacity  or  resource  as  the  primary  task 
may  be  more  sensitive  than  those  that  tap  separate  resources.  On  the  other 
hand,  those  that  tap  the  same  resource  may  Intrude  on  the  primary  task. 
Therefore,  this  project  was  directed  toward  determining  the  best  combina¬ 
tions  of  primary  and  secondary  tasks.  Much  of  the  researach  will  be  empiri¬ 
cal.  For  example,  the  memory  update  task  was  developed  as  a  secondary  task 
In  which  the  amount  and  the  rate  of  Information  presented  to  subjects  could 
be  varied.  Analysis  of  performance  scores  and  SWAT  (Subjective  Workload 
Assessment  Technique)  ratings  Indicated  that  both  variables  were  effectively 
manipulated.  Future  studies  will  concentrate  on  combining  this  task  with 
other  tasks  and  determining  Its  sensitivity  to  workload. 
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COMMAND  CONTROL  WORKLOAD 

Workload  assessment  Is  included  In  evaluations  of  the  adequacy  of  human 
engineering  in  operational  Air  Force  Command  Control  Systems.  Subjective 
workload  scales  are  Included  in  crew  opinion  surveys  to  supplement  direct 
observation  and  measurement  of  primary  task  performance.  Primary  task  meas¬ 
ures  include  frequency  and  duration  of  crew  interactions,  telephone/ radio 
coiimunicatlons,  display  viewing  and  adjustment,  and  checklist  use.  Indirect 
measures  of  task  loading  are  derived  from  counts  of  the  classes  of  Informa¬ 
tion  Input/output  Identified  In  functions  analyses. 

Video/audio  tape  recordings  facilitate  assessment  of  workload  Indicated  by 
overt  behavior.  Correlational  analysis  is  used  to  obtain  estimates  of  the 
amount  of  variance  In  judged  workload  accounted  for  by  various  task  activi¬ 
ties.  Results  are  used  as  a  partial  basis  for  recommended  human  engineering 
design  Improvements  Including  changes  In  procedures,  workplace  layout, 
performance  aids,  task  allocations,  etc. 

SYNTHETIC  DATA  SYSTEM 

Industrial  and  engineering  methods  have  been  evaluated  to  determine  feasible 
candidates  for  adaptation  to  Air  Force  crew  workload  assessment  and  alloca¬ 
tion.  It  was  determined  that  a  combination  of  time  synthesis  methods  and 
standard  data  systems  was  most  appropriate.  However,  significant  develop¬ 
ment  Is  required.  Deficiencies  of  systems  currently  used  for  Industrial 
purposes  are:  (1)  lack  of  consideration  for  divided  attention  effects,  and 
(2)  Inadequate  data  on  performance  time  distributions.  Data  were  collected 
on  motor-perceptual  tasks,  perceptual-mediation  tasks,  display  reading  and 
communication  as  a  first  step  toward  data  base  development.  Results  Indi¬ 
cate  that  a  "Synthetic  Data  System"  Is  feasible  and  that  It  could  be  com¬ 
bined  with  computer  system  simulations  and  computer-aided  design  to  form  a 
viable  approach  to  workload  Issue  resolution  both  during  and  after  system 
development.  Contractual  support  for  this  effort  was  provided  by 
Professor  James  Buck,  formerly  of  Purdue  University,  now  at  the  University 
of  Iowa.  Documentation  Is  being  prepared  for  this  effort. 
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DEVELOPMENT  AND  TRANSFER  OF  TIMESHARING  SKILLS 

Performance  on  two  different  task  combinations  was  examined  for  evidence 
that  timesharing  skills  are  learned  with  practice  and  can  transfer  between 
task  combinations.  One  combination  consisted  of  two  discrete  Information 
processing  tasks,  a  short-term  memory  task  and  a  classification  task;  the 
other  consisted  of  two  Identical  one-dimensional  compensatory  tracking 
tasks.  Three  groups  of  16  subjects  were  employed  in  the  experiment.  The 
first  received  dual-task  training  on  both  combinations;  the  second  received 
single-task  training  on  the  discrete-task  combination  and  dual-task  training 
on  the  tracking  combination;  the  third  received  dual -task  training  on  the 
tracking  combination  only.  Evidence  for  distinct  timesharing  skills  was 
found  In  both  combinations  using  a  new  technique  designed  to  separate 
Improvements  in  timesharing  skills  from  Improvements  in  single-task  per¬ 
formance.  Transfer  of  timesharing  skills  also  was  found.  Several  fine 
grained  analyses  performed  on  the  data  from  the  discrete  task  combination 
and  a  control  theory  analysis  of  the  tracking  data  Indicated  that  skills  In 
parallel  processing  were  learned  in  each  combination  and  transferred  between 
them. 

INDIVIDUAL  DIFFERENCES  IN  DUAL-TASK  PERFORMANCE 

Eleven  right-handed  males  participated  In  an  experiment  examining  Individual 
differences  In  multiple-task  performance.  Three  task  combinations  were  used 
In  the  study.  The  first  was  composed  of  a  memory  task  and  a  classification 
task.  The  second  consisted  of  two  Identical  one-dimensional  compensatory 
tracking  tasks.  The  third  was  a  dlchotlc  listening  task.  On  day  1  of  the 
experiment,  the  subjects  practiced  each  task  alone.  On  days  2,  3,  and  4, 
they  performed  primarily  under  dual-task  conditions.  Periodically,  however, 
dual -task  practice  was  Interrupted  to  reassess  single- task  performance.  All 
dual -task  data  were  analyzed  first  to  determine  when  stability  occurred. 
Each  subject's  stabilized  data  from  the  tracking-tracking  and  memory- 
classification  combinations  then  were  corrected  for  the  appropriate  single¬ 
task  baseline.  Finally,  the  subjects  were  grouped  according  to  which  of 
three  response  strategies  they  used  to  perform  the  memory-classification 
task  combination.  These  strategies  were  a  massed  strategy  (In  which  the 
subject  would  emit  a  series  of  responses  to  one  task  before  responding  to 
the  other),  an  alternating  response  strategy,  and  a  simultaneous  response 
strategy.  A  two-way  repeated  measures  MANOVA  conducted  on  the  stabilized 
adjusted  data  Indicated  both  a  significant  effect  of  trials  and  groups. 
Possible  sources  of  the  between-group  differences  are  discussed. 
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RESIDUAL  ATTENTION  AS  A  PREDICTOR  OF  PILOT  PERFORMANCE 

Sixteen  student  pilots  performed  a  task  combination  consisting  of  a  choice 
reaction  time  task  at  1,  2,  and  3  bits  of  information  and  a  one-dlmenslona? 
compensatory  tracking  task.  Cross-adaptive  logic  was  used  to  keep  perform¬ 
ance  on  the  tracking  task  constant,  casting  the  be tween- subject  variance 
Into  the  choice  reaction  time  task.  Scores  on  this  combination  were  corre¬ 
lated  with  performance  on  flight  checks  administered  after  10,  20,  and 
30  hours  of  flight  training.  The  multiple  correlation  between  performances 
on  the  flight  checks  and  the  task  combination  increased  as  the  students 
progressed  through  flight  training.  The  usefulness  of  residual  attention  as 
a  predictor  of  pilot  performance  is  discussed. 

A  COMPARISON  OF  SINGLE-  AND  DUAL-TASK  MEASURES 
TO  PREDICT  PILOT  PERFORMANCE 

An  experiment  comparing  the  predictive  validity  of  single-  versus  dual-task 
measures  Is  reported.  Fifty-seven  males  received  two  trials  on  each  of  two 
Identical  one-dimensional  compensatory  tracking  tasks.  The  subjects  then 
attempted  to  perform  the  tasks  concurrently  for  25  trials.  Finally,  they 
performed  each  task  alone  for  one  trial.  The  subjects  then  were  given  a 
short  basic  flight  course  consisting  of  ground  Instruction  and  practice  In  a 
GAT-2  simulator.  After  completing  the  course,  the  subjects  were  asked  to 
perform  four  repetitions  of  a  descent,  a  descent  followed  by  a  stall,  and  a 
level  turn.  Performance  was  scored  by  an  instructor  and  an  observer.  Per¬ 
formance  In  the  simulator  then  was  correlated  with  performance  on  each 
tracking  trial.  The  predictive  validity  of  the  early  single-task  scores 
decreased  with  practice  while  the  dual-task  validity  Increased  throughout 
the  testing  session.  However,  the  predictive  validity  of  the  late  single¬ 
task  scores  was  almost  as  large  as  that  of  the  late  dual-task  scores.  Pos¬ 
sible  explanations  for  the  results  are  given. 

Donnell,  Michael  L. 
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MEASURING  SYSTEM  EFFECTIVE  OPERABILITY 

A  technique  for  measuring  the  effective  operability  of  major  air  systems 
[The  Mission  Operability  Assessment  Technique  (MOAT)]  has  been  developed. 
MOAT  combines  the  Pilot  Task  Inventory  (PTI)  approach  with  Multi -Attribute 
Utility  Theory  (MAUT),  which  Is  used  to  hierarchically  organize  and  deter¬ 
mine  the  importance  of  tasks  and  Psychological  Measurement  Theory  and 
Scaling  techniques.  In  particular  Conjoint  Measurement  and  the  Delta  Method 
of  Scaling.  System  Effective  Operability  is  defined  as  the  weighted  sum  of 
the  Operabilities  of  the  Individual  tasks.  The  weights  reflect  the  Indi¬ 
vidual  task's  criticalities  as  well  as  the  Importances  of  the  various  air¬ 
craft  phases,  subphases,  and  duty  levels  which  are  bases  for  the  hierarchi¬ 
cal  organization  of  tasks.  The  operability  of  an  Individual  task  Is  an 
additive  combination  of  workload  and  technical  effectiveness.  Measurement 
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theory  and  scaling  have  been  utilized  to  show  that  an  additive  combination 
Is  appropriate  and  to  determine  the  underlying  scales.  When  computerized, 
MOAT  allows  the  rapid  Identification  and  determination  of  the  relative 
magnitudes  of  system  operability  deficits. 

A  DECISION-ANALYTIC  AID  FOR  AVOIDING  COGNITIVE  OVERLOAD 

Decisions  and  Designs,  Inc.  (DDI),  has  proposed  an  approach  to  workload 
management  that  uses  a  cost/benefit  analysis  as  its  underlying  principle. 
The  commander  or  manager  of  a  complex  system,  such  as  a  submarine  or  an  air 
traffic  control  center,  is  viewed  as  having  a  limited  cognitive  capacity 
which  must  be  allocated  amongst  competing  demands  on  his  attention.  When 
the  total  demand  exceeds  capacity,  he  must  either  shed  some  of  his  load  or 
run  the  risk  of  a  breakdown  in  his  performance.  Cognitive  load  can  be  shed 
in  a  variety  of  ways  such  as  selective  attention,  task  simplification,  or 
responsibility  delegation.  However,  each  of  these  techniques  Is  likely  to 
produce  a  poorer  result  than  would  be  expected  If  the  commander's  full 
attention  were  devoted  to  the  task.  Thus,  shedding  cognitive  load  Involves 
a  cost  In  that  It  will  produce  poorer  performance  and  a  benefit  in  that  It 
reduces  the  demands  placed  on  the  principal  decision  maker.  Using  a  model 
of  the  costs  and  benefits  associated  with  shedding  cognitive  load,  a  com¬ 
puter  aid  could  help  a  decision-maker  determine  which  of  his  tasks  are  most 
critical.  The  aid  could  help  determine  how  and  when  to  delegate  responsi¬ 
bility.  As  necessary,  the  aid  could  help  allocate  a  decision-maker's  cogni¬ 
tive  capacity  over  the  tasks  that  must  be  performed.  In  these  ways,  the  aid 
could  help  avoid  cognitive  overload  and  enhance  an  individual's  ability  to 
manage  a  complex  technological  system. 

Dunn,  Richard  S. 

U.S.  Army  Research  and  Technology  Laboratory 
DAVDL-AS 

207-5  Ames  Research  Center 
Moffett  Field,  California  94035 
Ph.  (415)  965-5579 

TACTILE  DISPLAY  APPLICATIONS 

The  evaluation  of  a  new  tactile  display  concept  required  workload  compari¬ 
sons  between  visual  and  tactile  display  devices  and  between  alternate  tac¬ 
tile  display  designs  and  modes  of  operation.  Critical  tracking  and  cross- 
adaptive  subcrltlcal  tracking  tasks  developed  by  Jex  et  al.,  have  been 
refined  for  these  purposes.  These  workload  oriented  display  assessment 
procedures  are  part  of  a  program  to  develop  tactile  displays  for  operational 
helicopter  applications. 

GENERAL  PURPOSE  AND  SIMULATOR  ORIENTED  WORKLOAD  MEASURES 

A  long-term  research  objective  Is  to  develop  a  variety  of  workload  assess¬ 
ment  techniques  for  general  use  In  flight  simulator  research  and  other  R&D 
projects  bearing  on  helicopter  design  and  employment  by  the  Any. 
Approaches  under  Investigation  Include  secondary  task  time  estimation,  vocal 


measures  of  stress,  primary  and  secondary  task  performance  in  various  con¬ 
tinuous  and  discrete  tasks,  and  analytical  procedures  for  task  analysis. 
The  goal  Is  to  establish  a  variety  of  workload  measures  to  support  Army 
aviation  by  making  tactical  helicopter  crew  workload  a  more  predictable  and 
manageable  parameter  of  system  design. 

Edwards,  Richard  E. 

Consulting  Division 
Boeing  Computer  Sevlces 
919  South  West  Grady  Way 
Renton,  Washington  98055 
Ph.  (206)  251-3236 

WORKLOAD  MODELING 

A  considerable  amount  of  research  has  been  conducted  on  workload  associated 
with  maintaining  the  aircraft  state  vector  (l.e.,  tracking  tasks)  and  work¬ 
load  associated  with  subystem  operation  (l.e.,  discrete  tasks).  Much  of  the 
available  data,  however.  Is  not  In  a  form  that  can  be  readily  Incorporated 
Into  existing  computer  based  workload  models.  A  series  of  studies  Is  being 
conducted  to  develop  a  data  base  that  can  be  used  to  extend  the  capability 
of  existing  mathematical  models  of  human  tracking  behavior.  In  these 
studies,  workload  associated  with  manual  control  of  an  aircraft's  pitch  and 
roll  axes  Is  being  examined  under  a  number  of  different  environmental  and 
secondary  task  loading  conditions. 

WORKLOAD  ASSESSMENT 

A  series  of  part-task  and  full-mission  flight  simulations  will  be  conducted 
as  part  of  the  FAA  flight  deck  certification  effort  for  the  Boeing  757  and 
767  airplanes.  The  simulation  effort  will  Involve  both  fixed-base  and 
motion-base  research  simulators.  Objective  performance  measures  and  subjec¬ 
tive  measures  will  be  employed  In  a  direct  comparison  of  workload  between 
crewstatlons  with  traditional  electromechanical  Instruments  and  crewstatlons 
with  advanced  electronic  displays.  These  comparisons  will  be  made  under 
both  normal  and  degraded  mode  operations. 

Eggemeler,  F.  Thomas 
Department  of  Psychology 
Wright  State  University 
Dayton,  Ohio  45435 
Ph.  (523)  873-2444/2391 

SUBJECTIVE  WORKLOAD  ASSESSMENT 

In  many  applications  of  subjective  workload  measurement  techniques,  practi¬ 
cal  constraints  make  It- desirable  or  necessary  to  delay  completion  of  sub¬ 
jective  ratings  until  some  time  after  actual  task  performance.  This  raises 
a  question  concerning  the  possible  effects  of  such  delays  on  the  accuracy  of 
subjective  ratings.  On  the  basis  of  the  memory  literature.  It  can  be  pre¬ 
dicted  that  some  loss  of  Information  will  occur  at  relatively  short  reten¬ 
tion  Intervals,  but  little  data  currently  exist  that  address  the  specific 
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relationship  between  retention  Interval  and  accuracy  of  subjective  ratings 
of  workload.  A  series  of  studies  have  been  planned  to  examine  the  retention 
interval -workload  rating  relationship.  At  present,  the  first  study  Is 
underway.  In  this  initial  study,  subjects  perform  an  information  processing 
task  that  requires  that  they  update  and  recall  the  status  of  several  con¬ 
tinually  changing  categories  of  information.  Subjects  complete  a  subjective 
workload  rating  scale  either  Immediately  after  the  task  or  at  one  of  two 
retention  intervals.  Immediate  ratings  will  be  used  as  the  baseline  to 
assess  the  effects  of  retention  Interval  on  the  delayed  ratings.  Results  of 
this  first  study  will  be  used  to  structure  subsequent  efforts. 

Ephrath,  Arye  R. 

Bell  Laboratories  &  MIT/Center  for  Space  Research 
Bell  Laboratories 
6  Corporate  Place 
Piscataway,  New  Jersey  08854 
Ph.  (201)  981-7673 

INSTRUMENT  SCANNING  BEHAVIOR  AS  AN 
INDICATOR  OF  PILOT  WORKLOAD 

This  is  an  investigation  of  the  relationship  between  an  aircraft  pilot's 
visual  scanning  of  instruments  and  his  level  of  mental  activity  during  a 
simulated  approach  and  landing.  This  study  is  motivated  by  the  increasing 
concern  in  several  areas  of  man-machine  interaction  with  the  effects  of 
changes  in  manual  control  and  monitoring  procedures  on  mental  workload. 
This  concern  is  particularly  keen  with  regard  to  airline  pilots,  air  traffic 
controllers,  power  plant  operators,  and  personnel  in  control  of  large  ocean¬ 
going  vessels,  since  the  cost  of  error  can  be  quite  high  in  any  of  these 
man-machine  systems. 

Visual  scanning  behavior  plays  an  important  role  In  each  of  these  systems, 
since  the  operator  will  typically  be  required  to  monitor  a  number  of  instru¬ 
ments  which  display  system  state  variables.  In  each  of  the  above  roles,  the 
human  acts  as  a  decision  maker,  a  planner,  a  manual  controller,  a  monitor, 
and  an  event  detector.  His  ability  to  perform  these  tasks  Is  generally 
Influenced  by  their  nature,  number,  and  temporal  arrangement;  by  his  general 
physical  and  psychological  state;  and  by  the  occurrence  of  unusual  or  rare 
events  such  as  mechanical  failures,  bad  weather  conditions,  etc.  Ideally,  a 
human  operator's  job  should  be  designed  in  such  a  way  as  to  require  an 
appropriate  fraction  of  the  operator's  capacity.  To  accomplish  this  design 
objective,  however,  the  designer  must  have  a  method  at  his  disposal  of  esti¬ 
mating  the  expended  capacity  under  different  conditions.  While  there  exists 
a  number  of  these  methods,  none  Is  sufficiently  benign  and  noninvaslve  to  be 
used  in  the  field  (for  Instance,  In  an  airliner's  cockpit  In  flight).  Con¬ 
sequently,  we  have  set  out  to  develop  an  estimator  of  mental  loading,  based 
on  the  operator's  visual  scan  pattern. 

In  the  current  work,  experiments  were  conducted  In  a  Terminal  Configured 
Vehicle  (TCV)  flxee  -base  flight  simulator  at  NASA  Langley  Research  Center. 
Three  NASA  test  pilots  were  presented  with  a  piloting  task,  an  arithmetic 
task  designed  to  vary  mental  loading,  and  a  side  task  for  calibration  of  the 
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mental  loading  task.  The  pilot  lookpolnt  Mas  obtained  by  using  a  highly 
modified  Honeywell  oculometer  system,  and  the  pilot's  eye  scan  of  the 
Instruments  was  recorded.  The  piloting  task  Involved  flying  a  curved  Micro- 
wave  Landing  System  (MLS)  approach  from  a  specified  waypoint  to  touchdown. 

The  mental  loading  task  was  chosen  so  as  not  to  Interfere  with  the  visual 
scanning  of  the  pilot  while  providing  constant  loading  during  the  approach. 
This  was  accomplished  by  having  the  pilots  respond  verbally  to  a  series  of 
evenly-spaced,  three-number  sequences.  The  pilot  was  told  that  he  must 
respond  to  each  three-number  sequence  by  saying  either  "plus"  or  "minus" 
according  to  the  following  algorithm:  first  number  largest,  second  number 
smallest  =  "plus";  first  number  smallest,  last  number  largest  »  "plus"; 
otherwise  *  "minus."  The  numbers  were  recorded  at  20  second  and  10  second 
intervals.  These  Intervals  had  been  determined  empirically  to  vary  mental 
loading  under  a  similar  piloting  task. 

The  workload  measuring  side  task  employed  two  lights,  one  mounted  above  the 
other,  placed  just  outside  the  pilot's  peripheral  view  above  the  Instrument 
panel.  The  lights  came  on  at  random  intervals  between  1  and  Z  seconds  and 
remained  on  for  1  second.  The  pilot  was  told  to  turn  the  lights  off  by 
using  a  three-position  rocker  switch  on  the  control  grip  (movlna  the  switch 
up  turned  the  upper  light  off,  down  turned  the  lower  light  off).  This  was 
done  only  when  the  pilot  had  time  left  from  performing  the  primary  task  of 
flying  the  airplane.  Thus,  the  number  of  correct  responses  to  the  lights 
saved  a  measure  of  the  residual  capacity  of  the  pilot  from  which  a  workload 
index  could  be  calculated. 

A  computer  algorithm  has  been  developed  to  obtain  the  first-order,  discrete- 
state,  discrete-transition,  Markov  model  for  each  pilot's  scanning  pattern. 
It  Is  assumed  that  workload  Is  constant  within  each  of  the  six  approach 
segments  since  the  piloting  tasks  are  essentially  constant  over  each  seg¬ 
ment.  This  allows  comparison  of  the  Instrument  transition  matrices  for  each 
segment  with  those  obtained  under  different  loading  conditions.  The  rela¬ 
tionship  between  visual  scanning  and  workload  Is  given  by  the  change  In  the 
elements  of  these  matrices  as  loading  varies.  Higher  order  Markov  models 
may  also  be  used  to  provide  a  more  accurate  description  of  the  processes 
taking  place. 

MENTAL  WORKLOAD  IN  DECISION  TASKS 

The  Importance  of  an  operator's  mental  workload  In  manual  control  tasks  has 
been  Increasingly  recognized  In  recent  years.  As  a  consequence,  a  number  of 
mental  workload  evaluation  methods  have  been  developed  to  serve  as  system 
design  tools  for  tasks  In  which  the  human  serves  as  a  control  element  or  In 
which  he  fills  a  supervisory  (monitoring)  role.  These  methods  Include  per¬ 
formance  measures.  Identification  of  fractional -attention  parameters  In 
analytic  models,  secondary  tasks  (reserve  capacity)  techniques,  subjective 
scaling,  and  measures  of  correlated  physiological  variables. 

Research  is  needed  to  extend  the  state  of  the  art  from  the  realm  of  manual 
control  to  that  of  decision  making.  With  the  Increasingly  evident  shift  of 
the  human's  role  from  that  of  a  manual  controller  to  the  executive  level  of 
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a  decision  maker,  an  understanding  of  the  relationships  between  the  demands 
Imposed  by  decision  making  tasks  and  the  resulting  cost  In  mental  workload 
Is  essential. 

Our  approach  Is  to  construct  an  appropriate  decision  task  whose  level  of 
complexity  and  difficulty  can  be  controlled  In  the  laboratory.  Methods  will 
be  developed  of  measuring  and  quantifying  the  decision  maker's  mental  work¬ 
load  In  an  experimental  context.  In  parallel,  the  Optimal  Decision  Model 
(recently  developed  In  our  laboratory)  will  be  expanded  to  account  for  task 
complexity  and  for  the  effects  of  the  decision  maker's  workload  level.  The 
workload  evaluation  techniques  will  be  of  two  categories:  (1)  reserve 
capacity  index,  and  (2)  performance  measures,  it;  which  the  decision  maker's 
performance  (rate  of  incorrect  decisions,  for  instance)  co-varles  with  his 
mental  workload.  The  independent  (l.e.,  experimental)  variables  Include 
Imposed  decision  rate,  processing  time  requirements  prior  to  decison  making 
(i.e.,  complexity),  number  of  alternatives,  etc.  The  net  objective  is  the 
construction  of  a  canonical  workload  task  that  Is  readily  calibrated  In 
terms  of  noninvasive  measures. 

Fad^en,  D.  M. 

Boeing  Commercial  Airplane  Company 

P.  0.  Box  3999 

Seattle,  Washington  98124 

The  workload  assessment  techniques  used  in  the  design,  development,  and 
certification  phases  of  a  commercial  airplane  program  address  two  basic 
issues— timeliness  of  crew  actions  and  ease  of  operation.  The  crew  must  be 
able  to  complete  all  necessary  tasks  with  sufficient  reserve  time  to  accom¬ 
modate  unexpected  events.  Further,  the  mental  and  physical  effort  associ¬ 
ated  with  each  task  must  not  place  undue  stress  on  the  crew.  Both  objective 
and  subjective  methods  are  used  to  assess  the  Impact  of  the  flight  deck 
design  In  these  areas.  Analysis,  simulation,  and  flight  test,  used  singly 
or  In  combination,  have  proven  to  be  effective  techniques  for  addressing  a 
variety  of  workload  problems.  Analytic  techniques  are  of  particular  Inter¬ 
est  to  the  aircraft  manufacturer  since  hardware  suitable  for  full  scale 
simulation  or  flight  test  Is  not  available  until  late  In  the  development 
cycle. 

Timeline  analysis  Is  the  basic  means  of  ensuring  that  the  crew  will  have 
sufficient  time  to  accomplish  all  of  their  tasks.  During  design  and  devel¬ 
opment,  this  technique  Is  augmented  by  subsystems  workload  assessments  which 
evaluate  panel  layouts  and  procedures,  and  by  task-time-probability  analyses 
which  permit  variations  In  task  timing  and  crew  performance  to  be  examined. 
All  three  are  comparative  methods  enabling  a  new  design  to  be  evaluated  with 
respect  to  an  existing  airplane  or  subsystem  well  In  advance  of  any  hardware 
commitments.  Following  this  phase,  the  physical  aspects  of  workload, 
associated  with  hand  and  eye  motion,  are  confirmed  by  observation  using 
mockups,  flight  simulators,  and/or  flight  test. 

The  multidimensional  nature  of  what  Is  commonly  called  mental  workload 
requires  assessment  techniques  which  provide  attribute  profiles,  not  a 
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single  Index.  In  this  regard  we  have  found  specialized  subjective  ques¬ 
tionnaires  and  rating  scales  to  be  the  most  effective  neans  for  addressing 
mental  workload.  While  subjective  assessment  methods  are  very  useful,  they 
cannot  provide  Information  In  advance  of  hardware  availability.  We  are 
experimenting  with  Information-theoretic  estimates  of  cognitive  workload  as 
a  means  to  provide  a  preliminary  evaluation  of  mental  task  loading.  Such  an 
estimate  can  provide  a  common  measure  for  alternative  display  and  control 
devices,  allowing  for  a  tradeoff  between  them. 

Commercial  aircraft  workload  Is  qualitatively  different  than  that  associated 
with  high  performance  military  aircraft.  Commercial  aircraft  development  Is 
evolutionary— each  new  aircraft  flight  deck  draws  heavily  on  past  exper¬ 
ience.  The  population  of  pilots  flying  commercial  aircraft  changes  very 
slowly.  The  fundamental  tasks  and  decisions  expected  of  the  flight  crew 
remain  largely  the  same  from  one  vehicle  to  the  next.  It  follows,  there¬ 
fore,  that  new  workload  assessment  techniques  will  not  have  a  radical  Impact 
on  new  designs.  The  primary  benefits  to  be  expected  from  new  assessment 
methodologies  are  Improved  understanding  of  the  basis  for  particular  design 
decisions  and  greater  efficiency  In  the  design  process. 

Fregly,  Alfred  R. 

Air  Force  Office  of  Scientific  Research 

Life  Sciences  Directorate 

AFOSR/NL  Building  410 

Bolling  AFB 

Washington,  DC  20022 

Ph.  (202)  767-5024  (AUTOVON  297-5024) 

BIOCYBERNETICS/WORKLOAD 

Optimum  man-machine  sharing  and  control  of  Increasing  Information  processing 
loads  In  high  data  rate  environments  will  be  provided  by  means  of  new  blocy- 
bemetlc  techniques.  The  machine  operator's  psychophyslologlcal  responses 
will  be  displayed  to  machines  nonlnvaslvely,  on  line  In  real  time  via  an 
automated,  adaptive  feedback  loop.  Research  emphasis  will  be  given  to 
coding  of  brain-evoked  potentials  by  electrophyslologlcal  and  neurlomagnetlc 
means.  The  brain  wave  signatures  determined  across  a  broad  spectrum  of 
sensory,  cognitive,  and  motor  activities  will  serve  as  templates  for  devel¬ 
oping  new  neurological ly-based  metrics  of  human  operator  performance.  This 
will  assist  In  Identification  and  prediction  of  workload  factors  that  influ¬ 
ence  both  the  design  and  operation  of  crewstatlons  developed  for  critical 
training  and  operational  missions. 

This  program  Is  supported  by  Intramural  and  contractual  efforts  at  the  Aero¬ 
space  Medical  Research  Laboratory  under  Col.  Robert  O'Donnell  to  Improve 
man-machine  system  design  and  under  Andrew  Junker  In  control  theory  analy¬ 
sis;  and  at  the  Air  Force  School  of  Aerospace  Medicine  under  Dr.  John 
Courtrlght  In  workload  evaluation  In  multlstress  environments.  The  Air 
Force  Office  of  Scientific  Research  extramural  program  Is  managed  by 
Dr.  Alfred  R.  Fregly. 


Gabriel,  Richard  F. 

Human  Factors  Engineering 
Douglas  Aircraft  Co. 

Code  35-36 

3855  Lakewood  Boulevard 
Long  Beach,  California  90846 
Ph.  (213)  593-8642 

THE  USE  OF  MENTAL  PROCESSING  TIME  FOR  THE 
EVALUATION  OF  EADI  FORMATS 

Integrated  displays  are  commonly  evaluated  by  dynamic  tests  in  flight 
simulators  using  secondary  task  performance  measures  and  subjective  reports 
as  the  basis  for  evaluation.  Both  of  these  measures  are  of  questionable 
validity  when  applied  to  mental  workload  quantification  because  of  test 
artifacts,  biases,  etc.  This  project  evaluated  an  alternative  approach  that 
has  resulted  from  several  years  of  mental  workload  research  at  the  DougU; 
Aircraft  Company.  In  this  approach  mental  workload  is  defined  as  the  con¬ 
scious  mental  processes  Involved  In  work  and  quantified  as  the  time  required 
to  perform  the  mental  processes.  Three  versions  of  an  EADI  were  evaluated 
by  means  of  discrete  tests  of  the  time  required  for  subjects  to  obtain 
various  kinds  of  quantitative  and  qualitative  information  from  static  CRT 
displays.  The  results  Indicate  that  this  is  an  effective  means  of  evalu¬ 
ating  alternative  display  formats  during  early  design  phases. 

MENTAL  WORKLOAD  QUANTIFICATION  IN  A  CONTINUOUS  TASK  SITUATION 

The  purpose  of  this  current  project  Is  to  Investigate  objective  methods  of 
quantifying  mental  workload  Involved  in  obtaining  Information  and  making 
decisions  from  Integrated  displays.  It  Is  a  follow-on  to  a  previous  Inves¬ 
tigation  of  the  use  of  mental  processing  time  measures  to  evaluate  inte¬ 
grated  displays  In  a  discrete  task  situation.  In  the  present  project,  sub¬ 
jects  are  given  a  flight  plan  to  follow  using  controls  and  a  dynamic  CRT 
display  of  flight  parameters.  The  mental  processing  time  required  to  obtain 
information  and  make  decisions  will  be  measured  by  the  method  of  subtraction 
and  used  to  quantify  the  mental  workload  Involved  In  alternative  display 
formats. 

PUPILLOMETRIC  MEASURES  OF  MENTAL  WORKLOAD 

A  recently  completed  study  evaluated  the  use  of  puplllometer  (Gulf  &  Western 
Applied  Science  Laboratories  Model  1060- SRP)  to  assess  mental  workload. 
Subjects  were  given  three  levels  of  mental  arithmetic  under  two  conditions 
of  manipulated  stress  in  order  to  Isolate  purely  automatic  effects  from 
central  processing  factors.  The  results  are  being  analyzed. 

PHYSIOLOGICAL  INDICES 

The  efforts  of  this  project  are  focusing  on  two  major  categories  of  physio¬ 
logical  measurement.  Electroencephalographlc  (EE6)  and  electrooculographlc 
(EOG)  measures  are  being  researched, and  developed  as  potentially  unobtrusive 
Indices  of  aircrew  mental  workload.  A  brief  listing  of  research  topics  is 
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given  below  with  a  description  of  the  future  direction  for  development.  The 
laboratory  for  EEG  and  EOG  recording  is  just  becoming  operational,  and 
directions  for  future  development  may  change  dependent  on  what  measures 
prove  useful  for  operational  aircraft.  Topics  currently  under  study 
include: 

1.  Event  Related  Potential  (ERP),  P300  and  P165.  During  simulated 
flying,  ERPs  will  be  elicited  by  probe  stimuli  which  are  aural 
warning  events. 

2.  Iospotential  Contour  Mapping  of  Scalp  Voltage  Levels.  Employing 
multiple  electrode  arrays,  the  contour  mapping  strategy  of  mental 
workload  research  attempts  to  develop  concepts  and  metrics  for 
describing  focal  brain  activity. 

3.  EOG-Vergence  Angle  Measurement.  Measurement  of  vergence  angles  of 
pilots  with  EOG  techniques  may  permit  an  unobtrusive  measurement 
of  external  vision  in  an  operational  aircraft.  Under  some  circum¬ 
stances,  the  percent  time  available  for  external  vision  (eyes 
outside  the  cockpit)  may  index  overall  cockpit  efficiency. 

4.  EOG-Eyeblink.  Eyeblink  levels  are  being  assessed  as  Indices  of 
workload  during  selected  aircraft  mission  segments.  Past  efforts 
have  investigated  various  general  physiological  responses  such  as 
heart  rate  and  heart  rate  variability,  pulse  pressure,  pulse 
volume,  etc. 

Gerathewohl ,  Siegfried  J. 

Applied  Psychonomics,  Inc. 

5208  Albemarle  Street 
Washington,  DC  20016 

Presently  preparing  a  chapter  on  mental  workload  In  a  forthcoming  textbook 
on  Military  Aviation  Psychology  for  the  Department  of  Defense  of  the  Federal 
Republic  of  Germany. 

Gomer,  Frank  E. 

Engineering  Psychology  Department 
McDonnell  Douglas  Corporation 
P.  0.  Box  516 

St.  Louis,  Missouri  63166 
Ph.  (314)  576-8283 

PHYSIOLOGICAL  MONITORING  AND  MANNED  SYSTEM  PERFORMANCE 

Pilot  workload  considerations  are  beginning  to  have  a  distinct  cognitive 
emphasis,  due  to  changes  that  are  occurring  in  display  formats  and  operating 
procedures.  Consequently,  new  techniques  for  assessing  workload  must  be 
developed  that  are  more  sensitive  to  fluctuations  In  attentiveness  and  in 
the  capacity  to  time-share  among  several  system  demands  for  processing, 
decision  making,  and  action. 


A  flight  simulation  experiment  mbs  conducted  In  which  pilots  were  trained  to 
follow  a  commanded  flight  profile  and  maintain  airspeed  while  concurrently 
performing  threat  avoidance  and  target  acquisition  tasks.  Two  types  of 
brain  electrical  activity,  event-related  potentials  (ERPs)  and  the  “on¬ 
going"  electroencephalogram  (EEG),  were  analyzed  In  response  to  direct  mani¬ 
pulations  of  difficulty  In  executing  commanded  flight  maneuvers.  Because  of 
these  manipulations,  the  difficulty  of  time-sharing  was  Influenced  Indi¬ 
rectly.  Both  workload  level  and  continued  experience  with  the  flight  simu¬ 
lation  tasks  affected  the  magnitude  and  latency  of  the  P«QQ  component  of  the 
ERP,  as  well  as  the  distribution  of  the  EEG  power.  These  findings  support 
the  concept  of  multidimensional  processing  resources  and  the  distinction 
between  controlled  versus  automatic  modes  of  processing. 


The  results  of  this  Investigation  are  encouraging.  They  suggest  that  a 
physiological  method  used  to  evaluate  mental  workload  in  laboratory  settings 
may  be  applied  successfully.  In  at  least  some  instances,  to  situations  In 
which  Individuals  perform  operationally  relevant  tasks. 


Gopher,  Daniel 

Department  of  Industrial  Engineering  and  Management 
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Haifa,  Israel 
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A  GENERAL  APPROACH  TO  THE  MODELING  OF 
TIME-SHARING  BEHAVIOR 


Human  behavior  under  time-sharing  conditions  has  been  conceptualized  within 
a  framework  Inspired  by  concepts  and  methods  from  microeconomy,  drawing  an 
analogy  between  a  manufacturer  producing  one  or  more  products  and  a  person 
with  limited  resources  performing  one  or  more  tasks  (1,2).  This  approach 
has  been  used  to  discuss  possible  Interpretations  of  dual-task  performance 
wherein  concepts  such  as  task  difficulty,  demand,  resource  efficiency  and 
resource  allocation  have  been  clarified  and  defined.  Special  attention  Is 
devoted  to  the  Interaction  between  task  characteristics,  utility  considera¬ 
tion,  and  voluntary  control  of  resources.  A  survey  of  the  literature  and  an 
analysis  of  existing  models  of  human  capacity  have  led  us  to  outline  a 
multiple  resource  approach  In  which  the  human  processing  system  Is  assumed 
to  have  a  number  of  mechanisms,  each  having  Its  own  capacity. 

Our  goal  to  study  the  joint  effects  of  difficulty  parameters  and  allocation 
policy  resulted  In  the  development  of  special  experimental  techniques  to 
manipulate  task  priorities  In  concurrent  performance.  Response  surface 
design  has  been  employed  to  enable  economical  experimental  design.  Results 
have  been  analyzed  In  terms  of  families  of  operating  characteristic  func¬ 
tions.  Each  function  within  a  family  depicts  the  tradeoff  of  performance 
between  two  concurrently  performed  tasks  for  one  condition  of  task  diffi¬ 
culty,  when  resources  are  allocated  In  different  proportions  between  the 
tasks.  Experimental  tests  of  these  Ideas  have  been  conducted  using  two- 
dimensional  pursuit  tracking  tasks.  These  experiments  lend  support  to  the 
theoretical  approach  and  demonstrate  the  utility  of  the  methodological  tech¬ 
niques. 
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Ml  thin  this  general  framework,  our  experiments  during  the  past  year  were 
designed  to  substantiate  some  of  the  Ideas  suggested  In  the  earlier  work, 
clarify  the  notion  of  multiple  resources,  and  test  the  advantages  and  disad¬ 
vantages  of  such  an  approach  as  compared  with  alternative  Interpretations  of 
time-sharing  Interference.  Two  main  studies  motivated  by  the  results  of  the 
first  group  of  tracking  studies  were  completed.  In  one  experiment,  pursuit 
tracking  was  paired  with  binary  classification  tasks.  In  another  experiment 
tracking  was  performed  concurrently  with  variants  of  a  data  entry  task  that 
required  the  typing  of  letter  codes. 

The  first  experiment  was  designed  to  test  the  possibility  that  although 
vertical  and  horizontal  tracking  may  In  many  Instances  not  compete  for  allo¬ 
cation  of  common  resources,  their  coordination  In  joint  performance  taxes 
some  other  mechanisms.  This  Involvement  of  a  coordinating  mechanism  may  not 
be  relevant  to  tracking  performance,  yet  appear  In  the  performance  of  a 
third  task.  To  test  this  hypothesis,  we  had  subjects  make  binary  classifi¬ 
cation  of  digits  while  tracking.  To  guard  against  possible  effects  of 
peripheral  vision,  digits  were  presented  with  a  square  that  served  also  as 
the  control  symbol  or  the  target  symbol  for  the  tracking  task.  Memory  load 
was  manipulated  between  subjects.  Four  conditions  of  tracking  were  used: 
single  axis,  dual  axis,  dual  axis  with  feedback  Indicators,  and  dual  axis 
with  feedback  Indicators  and  unequal  priorities  on  the  two  axes.  Experi¬ 
mental  results  failed  to  reveal  the  existence  of  a  coordinating  resource. 
Similar  decrements  In  binary  classification  and  tracking  performance  were 
observed  under  single-axis  and  dual -axis  tracking  conditions.  The  addi¬ 
tional  requirement  to  allocate  resources  between  tracking  axes  In  unequal 
proportions  also  failed  to  affect  classification  performance.  We  have, 
thus,  concluded  that  dual -axis  tracking  Is  probably  not  more  costly  than 
single-axis  tracking  In  terms  of  any  resource  which  Is  not  used  directly  by 
tracking.  An  Interesting  outcome  was  the  overall  small  deficits  that  were 
observed  on  both  classification  and  tracking  tasks  under  dual  task  condi¬ 
tions,  which  suggests  that  some  of  the  large  deficits  reported  In  the  lit¬ 
erature  are  not  due  to  capacity  Interference,  but  are  caused  by  structural 
factors,  such  as  peripheral  presentations. 

In  a  second  experiment,  two-dimensional  pursuit  tracking  was  paired  with  a 
letter  typing  task  In  which  letters  appeared  on  the  screen  within  the  moving 
square  of  the  tracking  target  symbol  and  had  to  be  canceled  by  typing  the 
correct  letter  code  on  a  three-key  keyboard.  The  difficulty  of  this  task 
was  varied  by  Incrementing  memory  load  (larger  sets  of  letter  codes)  or 
Increasing  the  difficulty  of  motor  control  (selection  of  more  complex  motor 
response  patterns).  The  main  findings  of  this  experiment  were: 

1.  In  single  task  conditions,  both  difficulty  manipulations  yielded 
similar  decrements  In  typing  performance.  Manipulation  of  memory 
load  tended  to  cause  larger  decrements  than  motor  control 
difficulty. 

2.  In  dual  task  conditions,  typing  performance  further  deteriorated 
and  decrements  were  monotonlcally  related  to  task  difficulty. 


42 


/ 


3.  Difficulty  of  motor  control  interacted  with  the  relative  priority 
of  the  typing  and  tracking  tasks  while  memory  load  produced  a 
constant  additive  Increment  over  levels  of  priorities. 

These  results  confirm  our  previous  argument  that  the  locus  of  load  in  manual 
control  tasks  resides  in  the  motor  control  requirements.  The  results  also 
confirm  the  prediction  that  a  multiple  resource  model  in  which  difficulty 
manipulations  tapping  a  common  resource  for  concurrently  performed  tasks 
will  Interact  with  priorities,  while  manipulations  tapping  a  resource  rele¬ 
vant  to  one  task  only  will  result  In  additive  effects.  At  present,  we  have 
several  experiments  underway  that  seek  further  clarification  of  the  multiple 
resource  notion  and  Its  practical  implications  for  the  description  of  time¬ 
sharing  performance. 

TRAINING  PROCEDURES  TO  IMPROVE  TIME-SHARING  PERFORMANCE 

While  the  study  of  general  Issues  relevant  to  the  modeling  of  time-sharing 
behavior  Is  continued,  our  past  year's  and  current  research  is  marked  by  an 
Increased  Involvement  In  questions  related  to  training  and  development  of 
time-sharing  skills  and  the  determinants  of  improvement  in  time-sharing 
performance.  Is.  there  a  general  time-sharing  factor,  whether  Inherent  or 
acquired,  with  training?  Are  different  strategies  developed  for  the  per¬ 
formance  of  tasks  when  performed  singly  or  In  time-sharing  conditions?  What 
are  the  consequences  of  training  subjects  in  conditions  In  which  intertask 
priorities  vary  dynamically?  These  are  some  of  the  questions  addressed  in 
our  studies. 

An  experiment  presently  underway  In  our  laboratory  addresses  the  last  of  the 
above  questions— training  with  variable  priorities.  Two  types  of  training 
conditions  are  contrasted  In  this  experiment.  In  one  type,  tasks  are  per¬ 
formed  concurrently  and  no  priorities  are  Indicated,  or  equal  priorities  are 
emphasized  and  feedback  Indicators  are  displayed.  In  the  second  types,  the 
relative  emphasis  on  tasks  Is  dynamically  varied  during  training  and  sub¬ 
jects  are  required  to  allocate  their  resources  In  different  proportions 
among  the  tasks.  Training  with  fixed  or  unspecified  priorities  may  encour¬ 
age  development  of  single  optimal  Interweaving  strategy  or  even  integration 
of  the  tasks.  Training  with  variable  priorities  disrupts  Integration  but 
sensitizes  subjects  to  the  efficiency  of  resources  and  the  consequences  of 
their  allocation  In  various  proportions  to  the  concurrently  performed  tasks. 
The  effects  of  the  two  training  schedules  are  Investigated,  employing  pur¬ 
suit  tracking  and  the  letter  typing  task  described  earlier.  Partial  analy¬ 
sis  of  the  results  show  that  the  group  trained  with  variable  priorities 
demonstrated  larger  Improvement  and  higher  levels  of  final  performance  than 
all  other  groups.  When  transferred  to  a  new  condition  In  which  priority 
Instructions  and  feedback  Indicators  were  eliminated,  the  group  trained 
under  variable  priorities  was  superior  to  the  other  in  Its  ability  to  shift 
resources  In  order  to  protect  constant  performance  levels  under  uninformed 
variations  of  task  difficulty.  The  encouraging  first  results  of  these 
experiments  are  currently  substantiated,  and  further  experiments  are  being 
conducted. 
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ULTRADIAN  RHYTHMS  IN  SUSTAINED  ATTENTION  TASKS 

Short-term  rhythmic  fluctuations  In  alertness  may  be  of  special  significance 
for  the  understanding  of  the  behavior  of  subjects  in  sustained  attention 
tasks.  Oscillatory  variations  In  the  quality  or  speed  of  performance  (some¬ 
times  referred  to  as  lapses  of  attention)  of  radar  observers,  radio  opera¬ 
tors,  air  traffic  controllers,  drivers,  pilots,  etc.,  are  frequently 
observed  and  most  commonly  treated  as  a  random  factor  or  considered  to 
reflect  noisy  elements  of  the  human  processing  system.  It  may  be  that  the 
short-term  variability  in  physiological  activity  and  behavior  can  be  linked 
together  and  shown  to  reveal  regularity  and  organization. 

Our  research  investigates  the  relationship  between  90  minute  rhythmic  cycles 
of  physiological  processes  and  the  performance  of  skilled  psychomotor  tasks. 
One  of  the  interesting  findings  in  this  research  is  that  the  physiological 
cycle  affects  the  accuracy  of  the  movements,  but  does  not  affect  their 
speed.  Cyclical  increases  and  decreases  in  the  accuracy  measure  of  motor 
movements  were  observed  with  a  peak-to-peak  interval  of  100  minutes.  Cycle 
deviation  corresponded  but  was  not  synchronized  with  physiological  pro¬ 
cesses.  No  such  changes  were  observed  in  the  speed  of  movements.  Addi¬ 
tional  data  are  being  collected  for  a  wide  battery  of  performance  tasks. 
The  discovery  of  ultradian  cycles  in  performance  may  lead  to  many  applica¬ 
tions  in  industry. 

Gunning,  David  R. 
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KC-135  AVIONICS  MODERNIZATION  PROGRAM 

The  goal  of  the  program  is  to  design  a  two-pilot  crewstation  for  the  135 
which  would  eliminate  the  navigator.  A  series  of  simulation  studies  are 
being  conducted  to  identify  the  avionics  and  automation  required  to  replace 
the  navigator.  During  the  studies,  workload  measurement  is  a  critical  prob¬ 
lem.  Workload  in  the  existing  KC-135  has  been  measured  by  recording  the 
time  spent  on  various  cockpit  tasks  during  operational  flights  by  a  battery 
of  measures  (i.e.,  performance,  task  loading,  secondary  task,  and  subjective 
ratings). 

Harris,  Sr.,  Randall,  L. 

NASA  Langley  Research  Center 
Flight  Dynamics  &  Control  Division 
Hampton,  Virginia  23665 
Ph.  (804)  827-3871 

PILOT  WORKLOAD  AND  SCANNING  BEHAVIOR 

Pilot  workload  is  composed  of  at  least  two  components:  the  physical  and  the 
mental.  Physical  workload  has  been  measured  for  years;  however,  the  mental 
workload  is  more  difficult  to  quantify.  There  is  a  possibility  that  eye 
scanning  data  can  be  used  to  quantify  mental  workload.  Laboratory  tests 
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have  been  conducted  which  have  attempted  to  establish  such  a  link  between 
mental  workload  and  eye  scanning  data.  In  the  tests,  mental  activity  was 
altered  by  utilizing  controlled  levels  of  an  auditory  side  task.  The  pur¬ 
pose  of  this  auditory  task  was  to  rob  time  from  the  primary  flying  task.  As 
the  difficulty  of  the  auditory  task  Increased,  the  pilot's  scanning  behavior 
was  affected.  The  pilots  stared  at  the  primary  instrument  and  looked  at 
the  peripheral  Instruments  less.  In  addition,  their  scanning  sequences  were 
disrupted  with  the  Increases  In  auditory  task  difficulty.  This  staring  and 
sequence  disruption  were  more  pronounced  for  the  less  skilled  pilots.  The 
performance  on  the  flying  task  was  poorer  with  increases  In  auditory  task. 
The  results  of  the  laboratory  tests  suggest  that  It  is  desirable  to  use  an 
auditory  task  to  Increase  the  overall  mental  workload  high  enough  such  that 
system  performance  Is  affected,  reflecting  differences  In  display  quality  or 
procedure  effectiveness. 

Hart,  Sandra  G. 
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TIME  ESTIMATION  AS  A  SECONDARY  TASK 

For  the  past  four  years  different  apsects  of  time  estimation  have  been 
investigated  with  the  goal  of  developing  a  series  of  easy  to  use  flight- 
related  Indic'es  of  primary  task  load.  To  date,  such  variables  as  technique 
(counting,  tapping,  neither,  etc.),  method  (verbal  estimation,  production), 
concurrent  activity  (tracking,  monitoring,  simulated  aircraft  and  helicopter 
flight,  etc.)  and  feedback  (presence  or  absence,  persistence)  and  the  inter¬ 
actions  among  these  factors  have  been  studied  by  myself  and  a  group  of 
graduate  students  at  Ames  Research  Center.  The  production  method,  particu¬ 
larly  If  subjects  do  not  count  and  do  not  receive  feedback,  is  the  easiest 
to  Implement,  although  there  are  some  methodological  problems.  Reports  have 
been  issued  or  are  being  written  on  the  whole  sequence  of  experiments.  Few 
future  experiments  are  planned  except  for  full  mission  validation  and  cross¬ 
correlation  with  other  measures  of  workload. 

DEFINITION  OF  SUBJECTIVE  EXPERIENCE  OF  WORKLOAD 

In  order  to  use  subjective  rating  scales  of  workload,  it  is  essential  to 
determine: 


1.  What  it  is  about  an  experience  that  produces  the  subjective 
experience  called  "workload"  (e.g.,  doing  more  than  one  expected, 
fatigue,  confusion,  uncertainty,  competition  between  tasks,  etc.). 
Simply  the  task  demands  or  resulting  performance  are  not  enough  to 
explain  the  fluctuations  In  response  and  performance  that  are 
obtained  with  apparently  similar  tasks  for  the  same  subjects.  It 
Is  often  the  circumstances  under  which  the  task  requirements  are 
met,  the  expectations,  experiences,  motivations,  training  level, 
etc.,  of  the  pilot,  and  other  so-called  Intervening  variables  that 
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generate  different  ratings  of  subjective  workload.  Using  a  modi¬ 
fication  of  the  Sheri dan/Tulsa  moving  boxes  paradigm.  In  which  the 
pilots  will  be  required  to  perform  a  series  of  flight-related 
tasks  reduced  to  the  simplest  possible  elements  presented  with 
varying  amounts  of  uncertainty.  In  various  orders,  under  different 
circumstances  In  order  to  determine  what  aspects  of  the  situation 
produce  fluctuations  In  the  subjective  ratings  of  workload. 

2.  Determine  how  to  retain  the  pilot's  memory  of  his  cognitive  work¬ 
load  during  a  task,  when  querying  him  at  the  conclusion  of  the 
task  with  a  subjective  rating  scale.  It  Is  clear  that  indivi¬ 
duals'  memory  of  how  many  decisions  they  made,  how  many  times  they 
monitored,  perceived,  calculated,  estimated,  projected,  listened, 
etc.,  during  an  Interval  is  very  faulty  and  that  the  cognitive 
components  of  preceding  activity  are  the  least  likely  elements  to 
be  represented  In  a  pointed  and  detailed  assessment  of  workload 
made  retrospectively.  Full  mission  simulations  are  planned  In 
which  pilots  of  a  single-engine  aircraft  simulator  and  a  747  simu¬ 
lator  will  be  asked  to  give  detailed  evaluations  of  their  cogni¬ 
tive  processes  during  and  after  flights  with  different  techniques, 
scales,  and  memory  aides.  The  subjective  rating  scales  that 
evolve  from  the  two  experimental  approaches  will  be  used  by  NASA 
and  the  FAA  In  their  effort  to  evaluate  the  concept  of  providing 
pilots  with  a  cockpit  display  of  traffic  control  Information 
(CDTI)  and  by  other  research  programs  at  Ames. 

SUMMARY  OF  WORKLOAD  ASSESSMENT  RESEARCH 
AT  AMES  RESEARCH  CENTER 

The  workload  assessment  effort  at  Ames  Research  Center  has  been  recently 
expanded  and  formalized  Into  a  separate  program.  The  purpose  of  the  program 
Is  to  Investigate,  develop,  validate,  and  standardize  subjective  and  objec¬ 
tive  measures  of  pilot  workload  and  performance  In  laboratory,  simulation, 
and  In-flight  environments.  In  order  to  do  this,  we  felt  that  the  following 
questions  should  be  addressed: 

What  role.  If  any,  do  fatigue  and  emotional  stress  play  In  the  subjec¬ 
tive  experience  of  workload? 

Does  the  term  workload  refer  to  the  demands  placed  on  an  operator,  the 
effort  he  expends  trying  to  meet  the  demands,  or  his  success  In  doing 
so? 

Can  pilots  distinguish  among  different  sources  of  workload,  such  as 
physical,  perceptual,  etc.? 

What  Is  It  about  the  circumstances  under  which  a  task  Is  performed  that 
alters  the  subjective  experience  of  workload? 

How  well  can  pilots  produce  reliable  and  valid  subjective  ratings  of 
workload  In  retrospect? 
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The  Initial  focus  will  be  on  the  development  of  subjective  rating  scales,  as 
these  appear  to  have  the  widest  application.  A  simple  pilot  opinion  survey 
was  recently  conducted  to  obtain  ratings  of  the  total,  perceptual,  cogni¬ 
tive,  and  physical  workload  Involved  In  general  aviation  flight.  These 
ratings  will  be  used  to  generate  primary  task  situations  with  different 
levels  and  dimensions  of  workload  to  serve  as  a  test  bed  for  the  workload 
assessment  program.  The  validity  of  this  aproach  will  be  assessed  with  a 
series  of  simulation  experiments  In  our  GAT-I  facility  in  November.  The 
results  of  this  study  will  be  described  at  Human  Factors.  Additional  labo¬ 
ratory  research  has  been  completed  In  which  a  series  of  subjective  rating 
scales  have  been  used  In  conjunction  with  part-task  simulations  focused  on 
Cockpit  Display  of  Traffic  Information  Issues.  Cooper-Harper  type  rating 
scales,  the  rating  scale  proposed  by  Airbus  Industries,  the  Pilot  Workload/ 
Technical  Effectiveness  scale,  and  several  sets  of  bipolar  adjective  scales 
were  studied  In  this  environment.  The  initial  results  of  this  work  will  be 
reported  at  IEEE  In  Atlanta  later  this  month.  Earlier  laboratory  research 
was  completed  In  which  simple  manual  control  tasks  were  used  to  generate 
different  levels  of  task  demands.  Fifteen  bipolar  adjective  scales  were 
used  to  evaluate  the  differential  effects  of  task  demands  (amplitude  or 
frequency  of  the  forcing  function  to  be  tracked),  pilot  effort  (RMS  stick 
activity)  and  performance  (RMSe/RMS-j)  on  the  experience  of  workload  and 
related  factors.  The  results  of  the  first  of  two  studies  was  presented  by 
Kathy  Bird  at  Annual  Manual  In  June.  Additional  studies  In  this  area  are 
planned  this  winter  In  which  cognitive  and  perceptual  tasks  will  be  used  In 
place  of  the  primary  physical  tracking  task  to  obtain  additional  subjective 
ratings  under  different  levels  of  task  demands.  Further  simulations  are 
also  planned. 

Hartzell,  E.  James 
AVRADCOM-NASA-Ames  Research  Center 
Moffett  Field,  California  94035 

PILOT  MODEL  BASED  ANALYSIS  OF  HELICOPTER  MISSIONS 

An  Important  problem  In  helicopter  mission  task  analysis  Is  the  assessment 
or  prediction  of  expected  pilot-vehicle  performance  and  associated  pilot 
workload  In  accomplishing  the  mission  objectives.  However,  existing  methods 
for  performance  and  workload  evaluation  and  forecasting  are  highly  empirical 
and  lack  a  cohesive  analytical  structure  or  framework.  In  an  effort  to 
remedy  this  situation,  the  U.S.  Arn\y  Aeromechanics  Laboratory  at  NASA-Ames 
Research  Center  has  Initiated  a  joint  long-term  program  committed  to  the 
development  of  an  analytical  technology  base  for  Improved  pilot-vehicle 
performance  and  workload  analyses. 

Selection  of  an  appropriate  model  structure  for  the  human  pilot  Is  crucial 
to  the  success  of  any  model -based  analytical  methodology.  Pilot  model  for¬ 
mulation  must  be  based  upon  a  thorough  understanding  of  the  mission  objec¬ 
tives  and  their  Impact  (as  perceived  by  the  pilot)  on  the  tasks  that  the 
pilot  must  perform  during  the  contiguous  flight  segments.  The  model  struc¬ 
ture  should  Incorporate  the  essential  elements  of  the  pilot's  Information 
acquisition/ processing,  decision  making,  and  control  behavior  within  a 
systematic  analytical  framework. 
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The  process  of  flying  consists  of  performing  a  hierarchy  of  tasks  corre¬ 
sponding  to  increasing  levels  of  cognitive  Involvement.  As  a  minimum, 
piloting  tasks  may  be  classified  into  two  hierarchical  categories: 

(1)  lower  level  autonomous  information  processing  and  control  tasks,  and 

(2)  higher  level  decision  making  tasks. 

A  hierarchical  model  for  the  pilot  based  upon  the  two  level  task  decomposi¬ 
tion  has  been  developed  and  exercised. 

Helm,  Wade  R. 

NADC  Code  6021 
Warminster,  Pennsylvania 
Ph.  (215)  441-2561 

SUBJECTIVE  RAriNG  OF  TASK  DIFFICULTY 

This  report  describes  work  done  by  the  Human  Factors  Laboratory  under  Navy 
Subcontract  Number  N00123-79-C-0159.  The  purpose  of  this  work  was  to  deter¬ 
mine  the  reliability  of  several  established  rating  scales  in  estimating 
cognitive  workload.  Results  of  this  study  indicate  that  ratings  of  task 
difficulty  are  significantly  related  to  performance  scores;  and  for  task 
difficulty  levels  up  to  performance  breakdown,  ratio  scale  ratings  are  sig¬ 
nificantly  more  accurate  relative  to  performance  scores  than  are  category 
scale  ratings.  Problems  of  implementing  each  type  of  scale  are  discussed. 
The  use  of  such  scales  will  allow  for  the  cost-effective  assessment  of  work¬ 
load  imposed  upon  operators  of  any  man-machine  system*  with  special  suita¬ 
bility  for  the  test  and  evaluation  stages  of  the  developing  F-18  air  system. 

Hopkin,  V.  David 

Royal  Air  Force  Institute  of  Aviation  Medicine 

General  Psychology  Section 

Farnborough  Hampshire 

United  Kingdom  GU14  6SZ 

Ph.  Aldershop  24461,  Ext.  4364 

HUMAN  FACTORS  IN  DESIGN  AND  EVALUATION  OF  AVIATION  MAPS 

An  extensive  program  of  work  on  workload  in  reading  maps  Is  Included  in  a 
recent  AGARDograph  reviewing  all  known  human  factors  work  relevant  to  avia¬ 
tion  maps.  Mental  workload  is  considered  In  relation  to  human  capabilities 
and  limitations,  particularly  of  cognitive  processing.  In  relation  to  task 
descriptions,  and  In  relation  to  methods  of  measurement  and  assessment  of 
maps.  There  is  not  a  separate  section  on  mental  workload  as  such  but  evi¬ 
dence  on  mental  workload  is  related  to  the  objective  of  designing  effective 
aviation  maps. 

HUMAN  FACTORS  IN  AIR  TRAFFIC  CONTROL 

A  continuing  series  of  evaluations  on  proposed  air  traffic  control  systems 
and  subsystems  for  regions  of  the  United  Kingdom  is  conducted  which  normally 
employs  measures  of  mental  workload,  most  commonly  subjective  ones.  A  paper 
on  mental  workload  (in  Moray,  1980)  related  to  air  traffic  control  sets  out 


the  problems  encountered  in  this  research.  Workload  measurement  In  air 
traffic  control  Is  also  covered  In  some  of  the  papers.  Including  my  own,  on 
air  traffic  control  In  the  special  Issue  of  Human  Factors  In  1980  devoted  to 
air  traffic  control.  Measures  of  mental  workload  have  generally  proven 
unsatisfactory  In  practical  air  traffic  control  contexts.  The  main  reasons 
seem  to  be  the  gulf  between  the  theoretical  interest  In  mental  workload 
which  Is  high,  and  the  practical  problem  of  mental  workload  which  Is  not 
simply  high  but  too  high  or  too  low,  so  that  practical  steps  must  be  taken. 
In  the 'form  of  system  design  changes,  equipment  changes,  changes  In  Instruc¬ 
tions,  changes  In  allocation  of  responsibilities,  changes  of  facilities,  or 
changes  of  training  etc.,  to  alter  a  workload  level  which  is  Inappropriate 
and  leading  to  Inefficiency  or  other  problems. 

Jahns,  Dieter  W. 

Crew  Systems  (2-3755) 

Boeing  Aerospace  Company 
P.0.  Box  3999,  Mall  Stop  45-46 
Seattle,  Washington  98124 
Ph.  (206)  773-1885 

TEST  BATTERY 

The  purpose  of  this  research  project  is  to  develop  a  test  battery  of  psycho¬ 
logical  and  physiological  measures  In  order  to  evaluate  both  the  level  and 
type  of  workload  found  In  a  flight  deck  environment.  As  the  measures  are 
defined  and  evaluation  methods  developed,  a  series  of  part-task  simulations 
will  be  conducted  to  determine  the  utility  and  sensitivity  of  the  selected 
measures.  Performance  measures  and  time-line  data  will  also  be  collected 
during  the  simulations  to  be  correlated  with  the  workload  data.  All  data 
will  be  used  in  the  development  of  a  workload  assessment  computer  model  for 
preliminary  design  evaluation. 

Jex,  Henry  R. 

Systems  Technology,  Inc. 

13766  South  Hawthorne  Boulevard 
Hawthorne,  California  90402 
Ph.  (213)  679-2281 

STUDY  OF  A  SIMPLE  CRITICAL  TASK  FOR  MEASURING  EFFECTIVE 
PILOT  DELAY  TIME  WHILE  TRACKING 

National  Aeronautics  and  Space  Administration,  Contract  NAS2-2288 

A  closed-loop  compensatory  tracking  task  was  developed  which  yields  a 
measure  of  thu  human  operator's  time  delay  characteristics  while  tracking, 
constrains  his  behavior  to  within  very  narrow  limits,  and  provides  a  low- 
variability  Indicator  of  the  operator's  tracking  ability.  The  task  Is 
called  the  "Critical  Task"  because  the  operator  Is  required  to  stabilize  an 
Increasingly  unstable  controlled  element  up  to  the  critical  point  of  loss  of 
control . 

Study  results  showed  that,  when  operating  near  criticality,  the  subject's 
behavior  was  adequately  represented  by  recently  developed  human  operator 
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describing  function  models  and  adaptation  laws.  Further,  the  extrapolation 
of  describing  functlorr  data  to  the  critical  level  of  instability  showed  that 
the  operator  consistently  loses  control  at  small,  but  finite,  mean  stability 
margins.  The  just-controllable  first-order  divergence  was  shown  to  be 
related  dominantly  to  the  operator's  effective  time  delay,  and  secondarily 
to  the  nominal  variations  of  his  average  tracking  characteristics  and  to 
mid-frequency  phase  lags  due  to  long  period  kinesthetic  adaptation  effects. 
It  was  also  found  that  the  human  operator's  characteristics  do  not  change  as 
the  system  Input  level  Is  decreased;  hence,  the  critical  task  yields  a  valid 
limit  when  excited  solely  by  the  operator's  remnant.  The  effects  on  the 
operator  of  different  control  device  types  (force,  spring,  and  free)  were 
Investigated  and  the  differences  in  critical  task  scores  related  to  the 
operator's  describing  function  characteristics.  Step  reaction  time  data 
were  compared  with  the  continuous  measures  of  effective  time  delay  and  the 
autopacer  scores.  A  sample  analysis  to  determine  the  number  of  autopace 
trials  necessary  to  achieve  a  confident  measure  was  made. 

EXPLORATION  OF  CONNECTIONS  BETWEEN  PILOT  OPINION  RATINGS, 

PILOT  DYNAMICS,  AND  SYSTEMS  CHARACTERISTICS 

Air  Force  Flight  Dynamics  Laboratory,  Contract  AF  33(615)-3960 

The  purpose  of  this  study  was  to  determine  the  correlation  between  pilot  and 
system  dynamics  on  opinion  ratings  and  to  evolve  a  valid  opinion  scale 
lacking  the  deficiencies  of  past  scales.  To  establish  the  effects  of  pilot 
and  system  dynamics  and  performance  on  opinion,  recent  data  gathered  under 
Air  Force  Contract  AF  33(657)-10835,  "Human  Pilot  Dynamics  In  Compensatory 
Systems,"  was  used.  The  results  of  that  study,  which  determine  the  oper¬ 
ator's  characteristics  and  behavior  with  dynamics  representative  of  a  number 
of  Idealized  flight  control  situations,  were  correlated  with  existing 
opinion  rating  data.  Thus,  the  effects  of  pilot  gain,  reaction  time  delay, 
equalization,  and  neuromuscular  system  characteristics  on  opinion  were 
determined.  At  the  same  time  a  refined  opinion  scale  (or  scales)  were 
evolved  through  a  careful  assessment  of  both  objective  and  subjective  pilot 
and  system  characteristics. 

Although  rating  scales  of  varied  forms  have  been  widely  used  to  estimate  and 
evaluate  handling  qualities  over  the  past  decade,  a  number  of  deficiencies 
In  both  method  and  data  base  have  been  apparent.  This  Investigation  was 
aimed  at  overcoming  many  of  these  deficiencies  by  attempting  to  resolve  the 
difficulties  experienced  with  rating  scales  themselves  and  by  extending  and 
adding  to  already  existing  relationships  between  ratings  and  pilot/vehicle 
system  parameters. 

Rating  scales  have  come  under  Increasing  criticism  for  problems  related  to 
wording  ambiguity,  the  dual  mission  character  of  some  scales,  the  nonunl- 
fonmlty  In  the  distribution  of  descriptors  across  the  scale,  and  the  misuse 
of  scales  which  has  occurred  when  ratings  have  been  averaged.  Psychometric 
methods  provide  an  approach  to  these  problems  and  In  this  study  were  used  to 
scale  several  phrases  descriptive  of  vehicle  handling  qualities.  Thus, 
quantitative  characteristics  were  derived  from  contemporary  scales  through 
the  use  of  a  scaling  technique  known  as  the  "Method  of  Successive  Inter¬ 
vals,"  where  data  for  the  method  were  obtained  from  a  survey  experiment. 
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An  experiment  was  conducted  which  added  to  available  data  relating  Cooper 
ratings  and  pllot/vehlcle  parameters,  and  which  also  tested  some  potential 
alternate  scale  candidates.  The  correlation  results  Indicate  that  ratings 
are  probably  based  on  performance  and  the  degree  of  difficulty  experienced 
In  maintaining  the  performance.  The  difficulty  Is  most  easily  represented 
by  the  pilot  equalization  required  and  the  vehicle  stick  characteristics. 

EXPERIMENTS  FOR  A  THEORY  OF  MANUAL  CONTROL  DISPLAYS 

National  Aeronautics  and  Space  Administration,  Contract  NAS2-3746 

This  research  effort  spanned  several  years  and  Involved  a  long-range  program 
to  develop  a  comprehensive  theory  for  understanding,  analyzing,  and 
Improving  the  pilot's  use  of  manual  control  displays.  One  facet  of  the 
program  was  to  evolve  efficient  and  analytical  models  for  the  pilot's 
tracking  of  quasl-predictable  forcing  functions  (e.g.,  following  the  optical 
landing  beam  of  an  aircraft  carrier  plunging  through  deep  ocean  swells, 
terrain-following  flight  over  rolling  countryside,  etc.).  As  a  part  of  the 
experimental  program,  a  novel  technique  was  used  to  force  the  subjects 
(skilled  instrument- rated  pilots)  to  scan  two  displays  In  a  manner  that  is 
realistic  yet  controllable  by  the  experimenter.  This  was  done  via  a  "sub- 
critical"  side  task  (stabilizing  a  slightly  unstable  first-order  plant), 
such  that  the  time  away  from  the  side  task  (i.e.,  available  for  the  main 
task)  Is  limited  by  the  time-constant  of  the  divergence.  In  order  to  pre¬ 
clude  parafoveal  cues,  eye-movement  signals  were  used  to  blank  the  nonfix- 
ated  display  In  certain  cases  and  some  performance  decrements  were  found. 
It  was  found  that  the  pilot's  average  scanning,  sampling,  and  reconstruction 
behavior  can  be  accurately  modeled  by  an  adjustable  quasi-llnear  describing 
function,  plus  an  Injected  "scanning  remnant"  (observation  noise)  having 
wideband  properties. 

The  model  was  validated  by  a  series  of  experimental  measurements  of  pilot 
scanning  and  control  response  in  a  simulated  instrument  approach.  Seven 
subjects  flew  Category  II-11ke  ILS  approaches  in  a  slx-degree-of -freedom 
fixed-base  DC-8  simulator  at  the  NASA  Ames  Research  Center.  A  conventional 
Instrument  panel  and  controls  were  used,  with  simulated  vertical  gust  and 
glide  slope  beam  bend  forcing  functions.  Pilot  eye  fixations  and  scan 
traffic  on  the  panel  were  measured  using  a  recently-developed  eye-polnt-of- 
•egard  (EPR)  system.  The  EPR  data  were  reduced  for  31  approaches  with  a 
cross-section  of  subjects  to  obtain  dwell  times,  look  rates,  scan  rates,  and 
fractional  scanning  workload.  Simultaneous  recordings  were  made  of  dis¬ 
played  signals,  pilot  response,  and  vehicle  motions  to  permit  their  corre¬ 
lation  with  the  eye  movement  results. 

RESEARCH  ON  A  NEW  HUMAN  DYNAMIC  RESPONSE  TEST  BATTERY 
National  Aeronautics  and  Space  Administration,  Contract  NAS2-4405 

A  battery  of  autopaced  critical -Instability  tasks,  subcrltlcal  tracking 
tasks,  and  step  reaction-time  tests  was  developed  to  permit  efficient  meas¬ 
urement  of  the  limiting  human  dynamic  response  properties.  Standard  test 
parameters  for  first-,  second-,  and  third-order  controlled  elements  (the 
latter  requiring  double-lead  equalization)  were  given.  Comprehensive  "base¬ 
line"  measurements  were  made  on  four  well  trained  subjects  (three  were 
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pilots)  using  a  specially-built  Controlled  Element  Computer  and  an  on-line 
Describing  Function  Analyzer.  The  resulting  data  Included:  tracking 
errors,  describing  functions  (and  derived  loop  closure  and  model-fitting 
parameters),  remnant,  critical  Instabilities,  and  reaction  times.  A  number 
of  simultaneous  psychophyslologlcal  measurements  were  also  made.  These 
Included  electrocardiogram,  “Instantaneous*  heart  rate,  breath  flow,  elec¬ 
tromyograms,  average  grip  pressure,  and  palmar  skin  resistance. 

These  data  showed  consistent  increases  In  the  neuromuscular  tension  Indica¬ 
tors  during  tracking.  Breathing  was  usually  faster  and  shallower.  The 
average  heart  rate  increased  for  only  two  of  the  four  subjects  but  distinct 
Increases  in  the  cardiac  "sinus  arrhythmia"  were  noted,  which  were  com¬ 
pletely  correlated  with  breath  flow.  Remarkably  simple  correlations  were 
obtained  between  the  critical  Instability  and  various  other  closed-loop 
dynamic  performance  metrics.  These  tests  and  results  constitute  the  founda¬ 
tion  for  a  series  of  continuing  experiments  on  effects  of  environmental 
stresses  and  workload. 

Also  as  a  part  of  this  program,  STI  administered  a  tracking  tasks  battery 
during  a  90-day  confinement  experiment  to  determine  the  physiological  and 
psychological  effects  of  long  duration  confinement  In  a  space  station  atmos¬ 
phere.  The  battery  Included  a  "clinical"  test  (Critical  Instability  Task) 
designed  to  measure  a  subject's  dynamic  time  delay  and  a  conventional  steady 
tracking  task,  during  which  dynamic  response  (describing  functions)  and 
performance  measures  were  obtained.  The  subjects  were  extensively  trained 
prior  to  confinement  and  generally  reached  asymptotic  performance  levels. 

Good  correlation  was  noted  between  the  clinical  critical  Instability  scores 
and  more  detailed  tracking  parameters  such  as  dynamic  time  delay  and  gain- 
crossover  frequency.  The  levels  of  each  parameter  spans  the  range  observed 
with  professional  pilots  and  astronaut  candidates  tested  previously.  The 
chamber  environment  caused  no  significant  decrement  on  the  average  crewman's 
dynamic  response  behavior  and  the  subjects  continued  to  improve  slightly  In 
their  tracking  skills  during  the  90-day  confinement  period.  Some  Individual 
performance  variations  appeared  to  coincide  with  moral  assessments  made  by 
other  investigators.  The  comprehensive  data  base  on  human  operator  tracking 
behavior  obtained  In  this  study  demonstrates  that  sophisticated  visual-motor 
response  properties  can  be  efficiently  and  reliably  measured  over  extended 
periods  of  time. 

RESEARCH  ON  THE  EFFECT  OF  DISPLAY  PARAMETERS 
ON  HUMAN  CONTROLLER  REMNANT 

Air  Force  Flight  Dynamics  Laboratory,  Contract  F33615-69-C-1808 

This  study  was  a  first  step  toward  the  long-range  goal:  to  develop 
efficient  analytical  models  for  human  controller  remnant  which  were  as  use¬ 
ful  as  current  quasi-llnear  pilot  models  In  manual  control/display  systems 
design.  This  contract  concentrated  on  selected  single-loop  display  situa¬ 
tions  In  which  remnant  Is  predicted  to  be  appreciable.  First,  using  new 
theoretical  guidelines,  an  extensive  archive  of  remnant  data  at  STI  was 
reanalyzed  to  provide  a  data  base  for  refining  the  remnant  models.  Then,  a 
series  of  brief  experiments  were  performed,  using  remnant-sensitive  displays 
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such  as  quantized  bar  graphs,  moving- tape  scales,  pnd  parafoveal  displays. 
These  experiments  made  use  of  the  STI-developed  Controlled  Element  Computer 
and  on-line  Describing  Function  Analyzer.  In  addition  to  describing  func¬ 
tions  and  remnant  spectra,  subjective  workload  ratings  and  (where  relevant) 
scanning  workload  were  measured. 

FLIGHT  EXPERIMENT  AND  FLIGHT  HARDWARE  SPECIFICATION  DEFINITION 
National  Aeronautics  and  Space  Administration,  Contract  NAS2-6409 

Contract  1IAS2-4405  brought  the  development  of  the  Critical  Tasks  Battery  to 
a  fruitful  stage  of  application  for  laboratory  research.  The  Mark  II  CTB  has 
been  used  In  the  NASA-McDonnel 1  Douglas  90-Day  Confinement  Experiment  and 
has  been  proposed  for  use  under  vibration  stress  and  g-stress.  An  orbital 
version  of  this  test  apparatus  has  been  proposed  for  a  space  experiment  on 
human  operator  dynamics  under  orbital  conditions.  This  contract  Involves 
completing  the  preliminary  research  and  design,  as  required  to  proceed 
rapidly  with  the  orbital  hardware  fabrication,  should  the  proposed  orbital 
experiment  be  approved.  Flight  experiments  and  hardware  specification  defi¬ 
nitions  Include  hybrid  analog  digital  CTB  mechanization,  finalization  of 
multlaxls  workload  test,  and  design  specifications  for  orbital  tester 
hardware . 

The  various  tests  In  the  battery  were  applied  to  a  set  of  simulated  Space 
Shuttle  reentry  experiments  utilizing  the  Ames  Research  Center  centrifuge. 
Effects  of  cardiovascular  deconditioning  were  Investigated  via  several  days 
of  bedrest. 

ENGINEERING  PSYCHOLOGY  RESEARCH  SERVICES 

National  Aeronautics  and  Space  Administration,  Order  No.  A-29602B 

This  program  was  part  of  an  Army  project,  funded  through  NASA,  to  establish 
and  develop  new  methods  to  measure,  quantify,  and  predict  helicopter  aircrew 
workload.  The  effort  provided  background  Information  to  guide  the  selection 
of  R&D  strategy  for  development  and  verification  of  this  new  methodology. 
It  was  coordinated  with  other  contract  and  In-house  technology  assessments 
of  workload  measurement  research  using  several  basically  different 
approaches.  This  part  of  the  project  concentrated  on  procedures  which 
assess  primary  task  performance  In  some  manner  as  the  basic  element  of  a 
workload  measurement  procedure.  To  accomplish  the  objectives  of  this  pro¬ 
gram,  a  comprehensive  survey  of  the  aerospace  human  engineering,  behavioral 
sciences,  flight  simulation,  and  vehicle  control  literature  was  made  to 
Identify  and  review  all  such  primary  task  measurement  methods  for  vehicle 
operator  workload  appraisal. 
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MENTAL  WORKLOAD  IN  A  SIMULATED  DRIVING  TASK 

Tracking  Is  one  Important  component  In  car  driving.  That  Is  why  It  Is  used 
as  a  paradigm  In  an  experiment  to  test  different  variables  as  workload  Indi¬ 
cators.  The  difficulty  of  the  main  task  Is  changed  In  three  levels  by 
varying  the  frequency  of  the  forcing  function  of  a  velocity  system  with  the 
one-dimensional  tracking  task.  Workload  Indicators  are: 

1.  A  unipolar  graphic  rating  scale. 

2.  A  secondary  task  where  a  pointer  moves  on  a  horizontal  scale;  the 
subject  has  to  press  a  knob  when  the  pointer  enters  a  warning  zone 
of  the  left  and  right  end  of  the  scale. 

3.  Different  measures  of  heart  rate  and  heart  rate  varablllty  (time 
domain  and  frequency  domain  measures). 

4.  Primary  task  measures  like  steering  reversals,  steering  activity. 

The  feasibility  of  these  Indicators  Is  examined  In  terms  of  reliability, 
validity,  and  freedom  of  interference.  Results  show  that  the  most  valid 
workload  Indicators  are  the  rating  scale  and  the  secondary  task.  Neverthe¬ 
less,  all  of  them  have  severe  limitations.  In  subsequent  Investigations, 
the  same  workload  Indicators  will  be  measured  In  experiments  with  a  car 
driving  simulator. 

Kantowltz,  Barry  H. 

Department  of  Psychological  Sciences 
Purdue  University 
West  Lafayette,  Indiana  47906 
Ph.  (317)  494-6861 

TIME-SHARING  AND  MENTAL  WORKLOAD 

Current  research  attempts  to  expand  the  hybrid  model  of  dual -task  perform¬ 
ance  proposed  by  Kantowltz  and  Knight  (1976).  Payoff  matrices  are  used  to 
sweep  out  performance  operating  characteristic  functions.  Results  are  con¬ 
sistent  with  the  hybrid  model  but  do  not  rule  out  alternative  models  of 
time-sharing. 

ENVIRONMENTAL  STRESS  AND  MENTAL  WORKLOAD 

This  research  uses  our  new  environmental  chamber  to  Investigate  double¬ 
stimulation  tasks  performed  at  varying  temperatures  and  humidities.  The 
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first  experiments  are  scheduled  for  Fall  1981  and  will  examine  narrowing  of 
attention  In  a  psychological  refractory  period  paradigm. 

RESPONSE  TOPOGRAPHY  AND  MENTAL  WORKLOAD 


Most  research  with  a  discrete  secondary  task  has  used  reaction  time  and 
error  rates  as  dependent  variables.  Since  response  topography  Is  a  more 
fundamental  aspect  of  behavior  than  Is  RT,  this  research  records  the  analog 
force  emitted  by  subjects  making  controlled  motor  outputs  on  Isometric  force 
transducers.  The  Initial  experiments  will  provide  single-stimulation  base¬ 
line  data.  Later  experiments  will  evaluate  mental  workload  In  two-handed 
movements  and  In  time-sharing  paradigms. 

Kennedy,  Robert  S.,  Dr. 

Canyon  Research  Group,  Inc. 

1040  Woodcock  Road 
Orlando,  Florida  32803 
Ph.  (305)  894-5090 

PROJECTED  WORKLOAD 

The  workload  literature  ordinarily  studies  the  effects  of  load  by  a  metric 
that  deals  with  the  amount  of  Information  that  is  presented/processed  per 
unit  of  time  over  available  pathways.  In  this  way,  functional  reserve  can 
be  assessed.  It  Is  my  Intention  to  expand  on  the  temporal  demands  of  work¬ 
load  (presently  limited  to  studies  of  keeping  track,  historically,  of 
several  things  at  once  with  changing  status)  by  measuring  how  far  Into  the 
future  the  controller  of  a  sy  cem  can  predict.  It  Is  expected  that  func¬ 
tional  reserve,  so  measured,  will  improve  with  practice. 

Lane,  Norman  E. 

Naval  Air  Development  Center 
Code  6021 

Warminster,  Pennsylvania  18974 
Ph.  (215)  441-2561 

NADC  PROGRAMS 

NAVAIRDEVCEN  has  two  major  programs  ongoing  at  the  center.  In  addition.  It 
supports  and  sponsors  work  at  other  government  centers,  particularly  that  at 
the  Naval  Air  Test  Center  (Sam  Schlflett).  The  latter  Is  separately  docu¬ 
mented  by  Dr.  Schlflett.  Current  NADC  programs  are  focused  principally  on 
workload  and  performance  estimation  models.  These  Include  the  Workload 
Assessment  Model  (WAN)  of  the  CAFES  system  and  the  Human  Operator  Simulator 
(HOS)  model. 
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Levine,  Jerrold  M. 

Director  of  Research 

Advanced  Research  Resources  Organization 
4330  East-West  Highway,  Suite  900 
Washington,  D.C.  20014 
Ph.  (202)  986-9000 

SECONDARY  TASK  REVIEW 

The  post- 1965  literature  on  the  use  of  secondary  tasks  In  the  assessment  of 
operator  workload  was  surveyed.  Twelve  classes  of  tasks  were  Identified; 
the  most  frequently  used  were  choice  reaction  time,  memory,  monitoring,  and 
tracking.  The  literature  review  did  not  suggest  a  single  best  task  or  class 
of  tasks  for  the  measurement  of  workload.  Limitations  In  using  secondary 
tasks  are  discussed,  and  directions  for  future  research  are  presented. 

Levlson,  William  H. 

Control  Systems  Department 
Bolt  Beranek  and  Neuman,  Inc. 

50  Moulton  Street 
Cambridge,  Massachusetts  02238 
Ph.  (617)  497-3362 

A  MODEL-BASED  TECHNIQUE  FOR  PREDICTING  PILOT  OPINION  RATINGS 

A  model -based  technique  for  predicting  pilot  opinion  ratings  has  been 
developed  and  tested.  Features  of  this  procedure,  which  Is  based  on  the 
optimal -control  model  for  pilot/vehicle  systems.  Include  (1)  capability  to 
treat  "unconventional"  aircraft  dynamics,  (2)  a  relatively  free-form  pilot 
model,  (3)  a  simple  scalar  metric  for  attentlonal  workload,  and  (4)  a 
straightforward  manner  of  proceeding  from  descriptions  of  the  flight  task 
environment  and  requirements  to  a  prediction  of  pilot  opinion  rating.  The 
method  is  able  to  provide  a  good  match  to  a  set  of  pilot  opinion  ratings 
obtained  in  a  simulation  study  of  large  commercial  aircraft  In  landing 
approach. 

MODELS  FOR  CREW  PERFORMANCE 

We  are  developing  analytic  models  to  examine  crew  performance  and  workload 
In  multi-task  environments.  Involving  both  continuous  and  discrete  tasks. 
The  models  will  permit  Investigation  of  the  effects  of  a  number  of  tasks  to 
be  performed,  selective  attention  to  tasks,  and  task  completion  times. 
Multioperator  situations  Involving  Intra-  and  extra-crew  communication  are 
also  being  studied  so  that  the  effects  of  such  communication,  as  well  as  the 
distribution  of  tasks,  on  predicted  crew  workload  can  be  examined.  The 
Initial  and  preliminary  applications  of  these  models  has  been  to  control  the 
analysis  of  the  remotely  piloted  vehicles  and  to  flight  crew  procedures  In 
approach  and  landing. 
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USER'S  GUIDE  TO  THE  TRACKING  TASK 

A  manual  will  be  written  to  guide  the  user  In  the  effective  use  of  the  con¬ 
tinuous  tracking  task  and  In  the  Interpretation  of  tracking  performance 
measures  as  they  apply  to  studies  of  mental  workload. 

ANALYTICAL  AND  SIMULATOR  STUDY  OF  ADVANCED 
TRANSPORT  HANDLING  QUALITIES 

An  analytic  methodology,  based  on  the  optimal -control  pilot  model.  Is 
demonstrated  for  assessing  longitudinal-axis  handling  qualities  of  transport 
aircraft  In  final  approach.  Calibration  of  the  methodology  Is  largely  In 
terms  of  closed-loop  performance  requirements,  rather  than  specific  vehicle 
response  characteristics,  and  Is  based  on  a  combination  of  published  cri¬ 
teria,  pilot  preferences,  physical  limitations,  and  engineering  judgment. 
Six  longitudinal -axis  approach  configurations  were  studied  covering  a  range 
of  handling  qualities  problems,  Including  the  presence  of  flexible  aircraft 
modes.  The  analytical  procedure  was  used  to  obtain  predictions  of 
(1)  Cooper-Harper  ratings,  (2)  a  scalar  quadratic  performance  Index,  and 
(3)  rms  excursions  of  Important  system  variables.  A  subsequent  manned 
simulation  study  yielded  objective  and  subjective  performance  measures  that 
varied  across  vehicle  configurations  In  the  manner  predicted  by  model 
analysis. 

Llndholm,  Ernest,  Ph.D. 

Department  of  Psychology 
Alrzona  State  University 
Tempe,  Arizona  95281 

TASK 

Pilots  at  various  levels  of  experience  will  fly  simulated  hostile  threat 
missions  In  the  A-10  or  F-16  versions  of  the  ASPT  (Advanced  Simulator  for 
Pilot  Training). 

1.  Description  of  Typical  Mission.  Pilot  is  released  In  a  safe  zone 
which  Is  approximately  4  minutes'  flying  time  from  the  hostile 
zone.  Pilot  flies  Into  hostile  zone  and  completes  a  mission 
(e.g.,  destroying  a  tank  or  other  object  by  cannon  fire.  Pilot 
will  be  In  the  hostile  zone  approximately  10  minutes  and  will  be 
fired  upon  by  AA  or  ground-to-air  missiles.  Pilot  then  leaves 
hostile  zone  and  flies  In  safe  zone  for  about  4  minutes.  Total 
mission  time  Is  about  18  minutes;  and  during  this  time,  the  pilot 
will  be  presented  with  tones  over  his  headset  every  five  seconds. 
There  are  three  tones  which  differ  In  frequency  and  which  communi¬ 
cate  specific  Information  to  the  pilot  as  follows:  1000  Hz  tone 
signals  NO  THREAT,  a  1500  Hz  tone  signals  MEDIUM  THREAT  (being 
tracked  by  radar  but  not  yet  fired  upon),  and  2000  Hz  tone  signals 
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HIGH  THREAT  (a  device  has  been  launched  against  your  aircraft). 
The  Information  provided  by  the  tones  Mill  always  be  veridical;  no 
deception  Is  Involved.  To  maintain  realism  for  the  pilot,  the 
number  of  MEDIUM  THREAT  and  HIGH  THREAT  tones  will  be  varied  on 
different  missions. 

2.  Each  pilot  will  fly  multiple  missions  Interspersed  with  short 
breaks. 

3.  The  purpose  of  the  tones  Is  to  elicit  event- related  potentials 

from  a  vertex  to  right  mastoid  derivation.  Preliminary  work  will 
be  conducted  at  ASU  to  Insure  that  the  different  tone  frequencies 
do  not  produce  different  ERPs  because  of  the  particular  frequen¬ 
cies  used,  rather  than  the  meaning  attached  to  them.  It  Is 

unlikely  that  the  small  range  of  frequencies  used  will  elicit 
different  ERPs  due  to  frequency  of  tone.  However,  It  Is  fully 
expected  that  the  ERPs  to  HIGH  THREAT,  MEDIUM  THREAT,  and  LOW 
THREAT  tones  will  differ  reliably  due  to  the  Information  value  of 
the  tones. 

DEPENDENT  VARIABLES 

ASPT  computes  several  Indices  of  mission  performance.  The  primary  thrust  of 
the  present  research  Is  to  relate  physiological  Indices  of  mental  workload 
to  ASPT  performance  variables.  The  physiological  variables  of  greatest 
Initial  Interest  are  heart  rate,  pulse  transit  time,  ERP,  and  eye  movement 
(EOG).  The  latter  Is  used  largely  as  a  control  for  the  ERP  since  large  eye 
excursions  can  contaminate  the  brain  wave  recording.  Other  possibly  rele¬ 
vant  measures  are  skin  conductance,  respiration  rate,  and  body  temperature. 
Exactly  which  set  of  physiological  variables  are  best  Indicators  of  workload 
Is  not  known  at  the  present  time;  Indeed,  one  goal  of  the  project  Is  to 
screen  different  measures  for  usefulness. 

SPECIAL  HARDWARE 

Custom  designed  6-channel  blotelemetry  systems  are  currently  being 
manufactured  by  UFI,  Morro  Bay,  California,  to  support  this  research. 


58 


t 


r~  - 


Linton,  Paul  M. 

Naval  Air  Development  Center 
Code  6021 

Warminster,  Pennsylvania  18974 
Ph.  (215)  441-2561 

NADC  PROGRAMS 

NAVAIRDEVCEN  has  two  major  programs  ongoing  at  the  center.  In  addition.  It 
supports  and  sponsors  work  at  other  government  centers,  particularly  that  at 
the  Naval  Air  Test  Center  (Sam  Schlflett).  The  latter  Is  separately  docu¬ 
mented  by  Dr.  Schlflett.  Current  NADC  programs  are  focused  principally  on 
workload  and  performance  estimation  models.  These  Include  the  Workload 
Assessment  Model  (WAM)  of  the  CAFES  system  and  the  Human  Operator  Simulator 
(HOS)  model. 

McCloy,  Thomas  M. 

Chief,  Human  Factors  Division 
DFBL/USAF  Academy 
Colorado  80840 
Ph.  (303)  472-3860 

INDIVIDUAL  DIFFERENCES  IN  TIME-SHARING  WITHIN  THE 
FRAMEWORK  OF  A  STRUCTURE-SPECIFIC  RESOURCES  MODEL 
OF  HUMAN  INFORMATION  PROCESSING 

The  objectives  of  the  research  are: 

1.  Develop  a  paper  and  pencil  Instrument  to  assess  certain  verbal  and 
spatial  abilities,  and  cognitive  styles  (e.p.,  field  Independence) 
which  are  considered  Important  In  flying. 

2.  Develop  a  psychomotor  test  battery  which  will  test  skills  specifi¬ 
cally  related  to  operational  flying  and  Investigate  time-sharing 
skills  within  the  framework  of  a  structure-specific  capacity 
theory  of  attention. 

3.  Determine  If  Individuals  maintain  a  consistent  relative  hierarchy 
among  the  structures  across  different  time-sharing  situations. 

4.  Investigate  the  relationship  between  specific  cognitive  abilities 
and  time-sharing  mechanisms. 

5.  Determine  which  time-sharing  performance  (l.e.,  time-sharing 
within  or  between  the  various  structures)  Is  the  best  predictor  of 
complex  flight  performance  In  a  simulator. 
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Mertens,  Henry  W. 

FAA/CAMI,  AAC-118 
P.O.  Box  25082 

Oklahoma  City,  Oklahoma  73125 
Ph.  (405)  686-4846 

THE  RELATION  BETWEEN  HUMAN  PERFORMANCE  AND 
BIOMEDICAL  INDICES  IN  EVALUATIONS  OF  POTENTIALLY 
ADVERSE  FACTORS  IN  THE  AVIATION  ENVIRONMENT 

The  purpose  of  this  project  is  to  define  the  biomedical  and  performance 
implications  of  the  kinds  of  stresses  imposed  on  aviation  personnel  (e.g., 
altitude,  fatigue,  sleep  loss,  drugs,  alcohol,  dieting,  and  medical  con¬ 
ditions).  This  task  of  the  CAMI  Aviation  Psychology  Laboratory  (AM-A-81- 
PSY-85)  provides  performance  measurement  support  to  the  Aviation  Physiology 
Laboratory's  task  AM-A-81-PHY-133.  The  CAMI  computerized  Multiple  Task 
Performance  Battery  (MTPB)  is  used  to  assess  complex  (time-sharing)  per¬ 
formance  in  a  synthetic  work  situation  involving  the  monitoring  of  light 
signals  and  meters,  processing  of  arithmetical  information,  problem  solving, 
visual  pattern  discrimination,  and  perceptual -motor  control  (two-dimensional 
compensatory  tracking).  Five  subjects  can  be  run  simultaneously  in  this 
apparatus.  Different  combinations  of  tasks  are  programmed  to  vary  workload. 
Subjects  are  typically  given  12  hours  of  practice  on  the  MTPB  before  experi¬ 
mental  testing  is  begun.  Data  analyses  are  based  on  time  and  accuracy  meas¬ 
ures.  In  addition,  a  composite  index  can  be  computed  to  reflect  the  overall 
quality  of  performance.  Relations  between  performance  and  biomedical  meas¬ 
ures  obtained  in  corollary  studies  by  the  Aviation  Physiology  Laboratory 
receive  special  emphasis. 

RECENT  RESEARCH 

Crash  Diet  Experiment.  FAA  statistics  reveal  that  the  weight  of  the  average 
civilian  airman  is  22.7  pounds  above  the  average  acceptable  weight  according 
to  weight/height  guidelines,  and  that  the  prevalence  of  obesity  is 
increasing  in  this  group.  An  experiment  was  conducted  to  evaluate  the 
effect  on  complex  performance  of  one  of  the  more  stringent  dieting  strate¬ 
gies,  the  crash  diet,  which  involves  abstinence  from  caloric  intake  for  at 
least  24  hours.  Performance  testing  with  the  MTPB  followed  both  a  24-hour 
crash  diet  and  a  24-hour  normal  diet.  During  performance  testing,  12  male 
subjects  breathed  an  O2/N2  gas  mixture  equivalent  to  12,500  feet,  the 
highest  altitude  at  which  continuous  flight  is  permitted  without  supplemen¬ 
tary  oxygen.  There  were  no  significant  effects  of  crash  diet  under  low 
workload.  Several  measurements  showed  a  slight  enhancement  of  performance 
by  crash  diet  under  medium  and  high  workload  conditions.  Physiological 
measurements  indicated  an  energy  conservation  pattern  (reduced  activity) 
during  the  crash  diet  condition.  Although  no  adverse  effects  of  the  crash 
diet  were  observed,  the  possibility  should  be  considered  that  longer  periods 
of  dieting  or  interactions  of  mental  and  physical  fatigue  with  dieting  could 
lead  to  performance  deficit. 

Smoking  Withdrawal  Experiment.  A  petition  to  the  FAA  to  prohibit  smoking  on 
the  flight  deck  of  "air  carrier  aircraft  led  to  an  experiment  which  evaluated 


60 


the  effects  of  short-term  smoking  withdrawal  on  the  complex  performance  of 
habitual  smokers.  Seventeen  men  and  women  who  were  habitual  smokers  per¬ 
formed  on  the  MTPB  In  two  4-hour  Intervals  In  the  other  session.  During 
testing  subjects  breathed  an  O2/N2  gas  mixture  equivalent  to  a  cabin  alti¬ 
tude  of  6,500  feet,  a  common  cabin  altitude  In  pressurized  air  carrier  air¬ 
craft.  When  smoking  was  prohibited,  MTPB  performance  decreased  signifi¬ 
cantly,  largely  as  a  function  of  decrements  In  tracking.  Higher  heart  rates 
and  higher  ratings  of  attentiveness  occurred  during  the  smoking  condition 
and  are  consistent  with  the  performance  data.  A  cautious  approach  to  the 
prohibition  of  smoking  during  flight  by  air  crewmembers  Is  suggested. 
Milder  approaches  such  as  smoking  cessation  programs  were  recommended. 
Future  research  In  this  area  should  concern  the  effects  of  longer  periods  of 
withdrawal  and  higher  cabin  altitudes. 

CURRENT  RESEARCH 

In  the  current  year,  data  collection  has  been  completed  In  an  experiment 
concerning  the  effects  on  complex  performance  of  the  Interaction  of  physical 
fatigue  and  altitude.  Performance  testing  occurred  In  ground  level  and 
altitude  (12,500  feet)  conditions  during  a  3.5  hour  recovery  period  fol¬ 
lowing  strenuous  exercise  and  control  treatments.  Data  analysis  Is  In  pro¬ 
gress.  Data  collection  Is  proceeding  In  a  study  of  the  Interaction  of  alco¬ 
hol  effects  with  altitude.  Subsequent  experiments  will  concern  the  effects 
of  mental  fatigue  as  a  function  of  age  and  the  effect  of  hangover  and  alti¬ 
tude  on  complex  performance. 

Molesko,  Norman  M. 

Hughes  Helicopters,  Inc. 

Human  Factors  Engineering 
Building  305,  Mall  Station  T75 
Centlnela  &  Teale  Streets 
Culver  City,  California  90230 
Ph.  (213)  505-5683 

RECENT  EFFORTS  IN  PLANNING  AND  DEVELOPING  HELICOPTER 
WORKLOAD  METHODOLOGY  AND  ASSESSMENT 

Methodology  has  been  planned  and  developed  for  conducting  and  assessing  crew 
workload  (timelines)  and  crew  coordination  (vlslonlcs  symbology  and  voice 
communications)  during  dedicated  two-manned  flight  operations  testing. 
Parameters  have  been  described  for  on-ground  and  airborne  collection  of 
quantitative  data  on  PCM  data  watanabe  strlpcharts  and  MUX  data  strip  plots. 
Measurement  Instruments  to  convert  crew  attitudes  on  crew  workload  and  crew 
coordination  to  numerical  values  by  scaling  techniques  have  also  been 
Investigated. 

FUTURE  EFFORTS  IN  APPLYING  HELICOPTER  MENTAL 
WORKLOAD  METHODOLOGY  AND  ASSESSMENT 

Activities  In  helicopter  workload  methodology  and  assessment  for  perceptual, 
medltatlonal,  communication,  and  motor  processes  are  being  proposed  for  the 
near  future. 
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Moray,  Neville 

University  of  Toronto 

Department  of  Industrial  Engineering 

Toronto,  Ontario  M5S1A4 

Ph.  (416)  978-6420 

FIGHTER  CONTROLLER  BEHAVIOR 

A  project  funded  by  M.O.D.  U.K.  to  measure  and  model  the  attention  behavior 
of  radar  operators.  Eye  movements  are  measured  in  simulators  and  live  sor¬ 
ties.  A  computer  model  of  the  behavior  is  being  developed  based  on  a  "dif¬ 
fusion"  theory  of  forgetting,  and  on  Markov  analysis.  Patterns  of  differen¬ 
tial  attention  given  to  different  aspects  of  the  display  are  emerging.  The 
role  of  memory  Is  particularly  emphasized. 

CORRELATION  OF  BEHAVIORAL,  PHYSIOLOGICAL,  AND 
SUBJECTIVE  WORKLOAD  MEASURES 

An  experiment  Is  planned  for  Autumn  1980  using  three  bandwldths  of  Gaussian 
noise,  three  orders  of  control,  heart  rate,  and  GSR  measures  (with  special 
Interest  in  the  0.1  Hz  component  of  heart  rate,  and  subjective  scaling  of 
difficulty.) 

DEVELOPMENT  OF  A  GENERAL  THEORY  OF  HUMAN 
INFORMATION  PROCESSING  AND  WORKLOAD 

This  uses  the  speed/accuracy  tradeoff  as  a  central  theme  and  concentrates  on 
sampling  models  of  attention  such  as  Sheridan's  Supervisor  Theory  and 
Senders'  Queuing  Theory,  plus  sequential  decision  making  and  exponentially 
weighted  forgetting  of  past  observations. 

Morgan,  Jr.,  Ben  B. 

Performance  Assessment  Laboratory 
Old  Dominion  University 
Norfolk,  Virginia  23508 
Ph.  (804)  440-4227 

PERFORMANCE  RESEARCH 

Our  research  has  not  been  directly  concerned  with  the  assessment  of  workload 
or  the  effects  of  workload.  Rather,  the  primary  thrust  of  our  research  has 
been  conducted  with  the  assessment  of  performance  effects  of  stressful  con¬ 
ditions.  In  this  research,  we  have  several  levels  of  workload  to  produce 
realistic  performance  requirements  In  a  synthetic  work  situation,  and  to 
determine  the  effects  of  various  stresses  on  performance  at  the  different 
workload  levels.  One  of  the  consistent  findings  has  been  that  the  effects 
of  stress  on  team  performance  is  directly  related  to  the  task  which  the 
team  Is  performing. 
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EFFECTS  OF  TRAINING  CONCURRENT-TASK  STRATEGIES 
ON  THE  ACQUISITION  AND  TRANSFER  OF  COMPLEX  SKILLS 

This  study  Investigates  the  acquisition  and  transfer  of  concurrent-task 
skills  of  different  workload  requirements  through  the  use  of  differential 
training  regimens  designed  to  influence  what  strategies  learners  adopt.  The 
purposes  of  the  study  are  to  determine  the  effects  on  enhancing  dual-task 
acquisition  and  transfer  to  a  multiple-task  criterion  of  (1)  differential 
training  conditions;  (2)  changes  in  training;  and  (3)  interactions  between 
different  concurrent- task  combinations  and  different  training  regimens.  The 
design  of  the  study  is  a  six-group  split-plot  with  two  phases  of  training. 

During  the  first  phase  of  training,  60  subjects,  in  groups  of  five,  will 
practice  mental  arithmetic,  vigilance,  and  a  group  procedural  task  under 
single-task  conditions  or  changing  priority  concurrent-task  conditions.  For 
the  concurrent- task  practice  groups,  each  of  the  three  tasks  will  be  com¬ 
bined  with  each  of  the  other  two  tasks.  The  practice  session  will  be  fol¬ 
lowed  by  a  multiple-task  transfer  session  composed  of  a  schedule  of  rapidly 
changing  task  combinations  and  demands.  During  the  second  phase  of 
training,  a  part  of  the  subjects  will  be  shifted  to  a  new  regimen  for  dual¬ 
task  practice,  followed  by  a  second  transfer  session. 

The  data  from  the  training  and  transfer  sessions  will  be  analyzed  by  means 
of  mixed  factorial  analyses  of  variance.  Both  rate  of  acquisition  and 
asymptotic  performance  will  be  tested.  It  is  hypothesized  that  type  of 
training  will  have  differential  effects  on  acquisition  and  transfer  of  con¬ 
current-task  skills.  Attention  will  be  given  to  the  differential  effects  of 
type  of  training  for  tasks  that  represent  different  workloads. 

INDIVIDUAL  DIFFERENCES  IN  MULTIPLE-TASK  PERFORMANCES 

Several  recent  efforts  have  provided  data  that  contribute  to  the  under¬ 
standing  of  individual  differences  in  multiple-task  performances  involving 
different  workload  levels.  Data  from  a  previous  Investigation  of  the 
effects  of  continuous  work  and  sleep  loss  on  subject's  performance  on  the 
Multiple-Task  Performance  Battery  (MTPB)  of  the  synthetic-work  methodology 
have  been  reanalyzed  so  as  to  examine  (1)  the  range  and  consistency  of  indi¬ 
vidual  differences  at  different  workload  levels,  (2)  individual  differences 
in  the  acquisition  of  skill  in  performing  tasks  representing  different  work¬ 
load  levels,  and  (3)  the  predictability  of  individual  performance  at  dif¬ 
ferent  workload  levels  during  continuous  work  and  sleep  loss.  Results  of 
these  analyses  indicate  that  there  are  very  large  individual  differences  in 
response  to  stress  at  all  workload  levels.  It  was  also  found  that  regard¬ 
less  of  workload  level  during  MTPB  performance,  individual  subjects  were 
quite  consistent  In  their  response  to  four  exposures  to  continuous-work  and 
sleep-loss  stress;  that  Is,  all  measures  of  performance  Indicated  that  poor 
(or  good)  performance  under  the  first  stress  exposure  were  also  poor  (or 
good)  performances  under  the  other  three  exposures.  These  consistent  indi¬ 
vidual  differences  also  seem  to  be  predictable  from  Individual  performances 
just  prior  to  the  stress  exposures  (correlations  across  the  four  exposures 
and  the  individual  performance  measures  ranged  from  .57  to  .99).  Other 


analyses  have  Indicated  that  within  the  synthetic-work,  multiple-task  situa¬ 
tion,  different  subjects  learn  a  given  task  at  different  rates.  Further¬ 
more,  for  a  given  Individual,  the  rates  of  skill  acquisition  are  different 
for  different  MTPB  tasks;  further  study  is  needed  In  order  to  determine  the 
extent  to  which  these  differences  are  due  to  difference  In  workload  produced 
by  the  different  tasks.  Recent  analyses  Indicate  that  rates  of  acquisition 
of  performance  on  the  least-difficult  tasks  (watchkeeping)  were  positively 
correlated  with  performance  during  stress,  whereas  rates  of  skill  acquisi¬ 
tion  on  the  most  difficult  task  (math)  were  negatively  correlated  with  per¬ 
formance  under  stress.  Additional  research  Is  needed  to  explicate  relation¬ 
ship  between  workload  effects  and  the  potential  utility  of  skill-acquisition 
rates  as  predictors  of  performance  under  stress  and  in  other  operational 
situations. 

Mulder,  6. 

University  of  6ron1gen 

Institute  for  Experimental  Psychology 

Kerklaan  30 

Karen,  Netherlands  g751NN 
Ph.  050-115200 

PROJECT  1,  RESOURCE  SPECIFICITY  OF  COMPONENTS  OF 
CORTICAL  EVOKED  POTENTIALS  (1980-1983) 

In  recent  theories  of  mental  workload.  It  Is  assumed  that  human  workload  Is 
a  multidimensional  construct;  that  Is,  the  workload  of  a  task  Is  not  a 
scalar  quantity  but  a  vector  quantity  associated  with  some  number  of  yet  to 
be  Identified  dimensions  (e.g..  Derrick,  1981).  Recent  research  suggests 
that  components  In  event-related  brain  potentials  can  be  used  In  the  assess¬ 
ment  of  allocation  of  attention  (e.g.,  Wlckens,  Heffley,  Kramer,  Donchln, 
1980). 

Especially  the  P300  has  been  proposed  as  an  Index  of  perceptual  load  on 
perceptual  resources. 

The  aim  of  our  project  Is  to  determine  the  sensitivity  of  endogeneous  nega¬ 
tive  and  positive  components  to  task  variables  affecting  perceptual,  cen¬ 
tral,  and  motor  mechanism.  The  following  task  variables  are  used: 

1.  Display  Load 

2.  Memory  Load 

3.  Combinations  of  Display  and  Memory  Load 

4.  Stimulus  Degradation 

5.  Training  In  Consistent  versus  Varied  Mapping  Conditions 

6.  Response  Probability 

7.  Stimulus  Response  Compatibility 
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Task  variables  1  and  2  are  also  examined  during  speed  and  accuracy  regimes. 

A  computer-algorithm  has  been  written  which  Identifies  specific  components 
in  single  trials. 

PRELIMINARY  RESULTS 

An  early  negative  component  (N175)  is  very  sensitive  to  display  load  but  not 
to  memory  load.  A  late  positive  component  (P550)  Is  very  sensitive  to  both 
memory  and  display  load.  Sensitivity  Is  visible  both  In  changes  In  latency 
of  amplitude  of  these  components.  Response  probability  also  affects  the 
P5Sq  component,  but  not  stimulus  response  compatibility. 

PROJECT  2,  TASK  RELATED  CARDIOVASCULAR  STRESS 

This  project  studies  the  sensitivity  of  cardiovascular  Indices  to  the 
processing  demands  of  mental  tasks.  The  main  dependent  variables  are  power 
spectrum  analysis  of  heart  rate  and  blood  pressure  fluctuations,  the 
preejection  period,  left  ventricular  ejection  time  and  pulse  transmission 
time.  Discrete  mental  tasks  are  used,  ranging  from  search  tasks  to  sentence 
comprehension  tasks  to  language  translation  tasks  (simultaneous 
Interpretation). 

Results  Indicate  that  the  0.10  Hz  component  of  the  cardiac  interval  signal, 
a  component  related  to  the  frequency  response  of  the  baroreceptor  reflex.  Is 
diminished  during  tasks  which  require  controlled  processing  and  In  which 
respiratory  activity  Is  regular,  and  Increased  during  tasks  which  require 
controlled  language  processing.  In  both  cases  the  homeostatic  mechanisms  of 
short-term  blood  pressure  control  are  highly  changed;  In  the  first  case 
there  Is  a  diminished  baroreceptor  sensitivity;  In  the  latter  case  baro¬ 
receptor  sensitivity  Is  Increased.  These  data,  together  with  other  Indices, 
Indicate  the  existence  of  different  required  cardiovascular  states.  Indi¬ 
vidual  profiles  Indicating  reactivity  are  used  as  a  first  step  In  Identi¬ 
fying  Individuals  at  risk. 

Murphy,  Miles  R. 

Aviation  Safety  Research  Office 
NASA-Ames  Research  Center 
MS  239-3 

Moffett  Field,  California  94035 
Ph.  (415)  965-5906 

WORKLOAD  AS  A  FACTOR  IN  AIR  CARRIER  INCIDENTS 
THAT  EXEMPLIFY  DEFICIENT  RESOURCE  MANAGEMENT 

A  set  of  250  commercial  aviation  incidents  exemplifying  deficient  team 
functioning  in  the  utilization  of  available  resources  was  selected  from  the 
7,689  incidents  reported  to  the  NASA  Aviation  Safety  Reporting  System  during 
the  period  from  15  April  1976  to  23  May  1978.  Each  Incident  was  rated  as  to 
the  extent  selection  criteria  were  met.  The  84  highest  rated  exemplars  were 
designated  for  more  comprehensive  analysis.  Resource  management  was  for¬ 
mally  defined  as  a  man-machine  system  concept.  A  definition-related  schema 
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for  Incident  analysis  was  developed  In  which  workload  was  one  of  the  pos¬ 
sible  categories  to  which  evolutionary  and  recovery  factors  were  classified. 
Workload,  here  used  to  categorize  factors  Involving  problematic  Input  load, 
enabled  or  contributed  to  the  evolution  of  25  of  the  84  Incidents.  In  many 
of  these  Incidents  deficient  workload  management.  Involving  an  Inadequate 
setting  of  task  priorities,  was  more  proximal ly  related  to  Incident  evolve- 
ment.  Details  of  this  study  are  documented  In  "Analysis  of  Eight-Four  Com¬ 
mercial  Aviation  Incidents:  Implications  for  a  Resource  Management  Approach 
to  Crew  Training,"  by  M.  R.  Murphy,  In  the  Proceedings  of  the  1980  Annual 
Reliability  and  Maintainability  Symposium^  22-24  January  1950,'  5an 
Frandsco,  California^  This  analytic  effort  Is  being  extended  in  depth  and 
to  Include  additional  Incidents. 

Navon,  David 

Department  of  Psychology 
University  of  Haifa 
Haifa,  Israel 

TASK  LOAD  AND  OPERATOR  ATTENTION  CAPACITY 
IN  TIME-SHARING  PERFORMANCE 

The  goals  of  this  Investigation  are  to  provide  conceptual  framework,  develop 
methodologies,  and  propose  measurement  procedures  to  assess  task  load  and 
operator  attention  capacity  In  the  performance  of  complex  tasks. 

Consistent  with  these  objectives,  a  new  approach  to  human  performance  under 
time-sharing  conditions  has  been  proposed  and  Initially  tested.  This 
approach  Is  based  on  economic  concepts  and  used  to  derive  predictions  and 
discuss  possible  sources  of  Interference  In  concurrent  performance.  Some 
prevailing  concepts  such  as  “difficulty,"  "resources,"  "load,"  and  "effici¬ 
ency"  have  been  formally  examined  and  redefined  and  new  distinctions  have 
been  proposed. 

To  get  a  complete  picture  of  performance  limitations  under  time-sharing 
conditions.  It  Is  proposed  to  manipulate  task  preference  as  well  as  diffi¬ 
culty  parameters  and  present  their  joint  effects  by  families  of  trade-off 
functions.  This  approach  was  applied  to  explore  the  Interactions  between 
axes  In  two  dimensional  tracking  tasks.  Additional  experiments  along  these 
lines  are  currently  being  conducted  on  pairs  of  tracking  and  digit  classi¬ 
fication  tasks  and  angular  tracking  paired  with  position  tracking. 

Two  directions  of  future  research  are  proposed:  one  represents  a  continued 
thrust  to  Identify  the  nature  and  sources  of  limitations  of  the  human  pro¬ 
cessing  system.  It  Is  accompanied  by  an  effort  to  develop  measures  of  work¬ 
load  under  time-sharing  conditions.  A  second  line  of  studies  Is  proposed  to 
Investigate  the  Implications  of  this  research  for  the  development  of 
training  procedure  and  learning  processes  In  the  acquisition  of  time-sharing 
skills. 
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North,  Robert  A. 

Honeywel 1  SRC 
2600  Ridgeway  Parkway 
Minneapolis,  Minnesota  55413 
Ph.  (612)  378-4136 

A  methodological  approach  to  measuring  workload  was  Investigated  for  evalua¬ 
tion  of  new  concepts  In  VTOL  aircraft  displays.  Physiological,  visual 
response,  and  conventional  flight  performance  measures  were  recorded  for 
landing  approaches  performed  in  the  NASA  Langley  Visual  Motion  Simulator 
(VMS).  Three  displays  (two  computer  graphic  and  a  conventional  flight 
director),  three  crosswind  amplitudes,  and  two  motion  base  conditions  (fixed 
versus  moving  base)  were  tested  In  a  factorial  design. 

Multivariate  discriminant  functions  were  formed  from  flight  performance 
and/or  visual  response  variables  to  maximize  detection  of  experimental  dif¬ 
ferences.  The  flight  performance  variable  discriminant  showed  maximum  dif¬ 
ferentiation  between  crosswind  conditions.  The  visual  response  measure 
discriminant  maximized  differences  between  fixed  versus  motion  base  condi¬ 
tions  and  experimental  displays. 

Physiological  variables  were  used  to  attempt  to  predict  the  discriminant 
function  values  for  each  subject/condition  trail.  The  weights  of  the 
physiological  variables  In  these  equations  showed  agreement  with  previous 
studies.  High  muscle  tension,  light  but  Irregular  breathing  patterns,  and 
higher  heart  rate  with  low  amplitude  all  produced  higher  scores  on  this 
scale  and,  thus,  represented  higher  workload  levels. 

O'Donnell,  Robert  D. 

AFAMRL/HE6 

Wright-Patterson  AFB,  Ohio  45433 
Ph.  (513)  255-2252 

AFAMRL  WORKLOAD  ASSESSMENT  PROGRAM 

The  USAF  Is  vitally  Interested  In  developing  and  implementing  techniques  for 
assessing  the  workload  Imposed  by  existing  and  future  systems.  A  major 
effort  Is  being  carried  out  by  the  Aerospace  Medical  Division,  Air  Force 
Aerospace  Medical  Research  Laboratory,  to  develop,  validate.  Implement,  and 
standardize  techniques  for  assessing  such  workload.  The  program  Is  broadly 
based  to  Include  subjective  measures,  behavioral /performance  measures,  and 
neuropsychological/physiological  measures.  Specific  experiments  are  being 
carried  out  by  a  number  of  Individual  principal  Investigators  to  Identify 
new  approaches  to  measurement,  test  technological  approaches  In  laboratory 
and  field  settings,  and  optimize  assessment  techniques  with  respect  to 
validity  and  sensitivity.  The  entire  effort  Is  designed  to  yield  usable 
standards  which  can  be  applied  to  systems  workload  evaluation  at  aqy  stage 
of  design.  Such  standards  are  projected  as  Air  Force  specifications  In 
CY8S.  In  addition,  several  generations  of  workload  test  batteries  and  com¬ 
puter  models  will  be  produced.  For  specific  efforts  under  this  program,  see 
Shlngledecker,  Eggemeler,  Wilson,  Reid,  and  Crabtree  entries. 
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Forschungglnstltut  fur  Anthropotechnlk 
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Federal  Republic  of  Germany 
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MENTAL  WORKLOAD  IN  A  SIMULATED  DRIVING  TASK 

Tracking  Is  one  Important  component  In  car  driving.  That  Is  why  It  Is  used 
as  a  paradigm  In  an  experiment  to  test  different  variables  as  workload  Indi¬ 
cators.  The  difficulty  of  the  main  task  Is  changed  In  three  levels  by 
varying  the  frequency  of  the  forcing  function  of  a  velocity  system  with  the 
one-dimensional  tracking  task.  Workload  indicators  are: 

1.  A  unipolar  graphic  rating  scale. 

2.  A  secondary  task  where  a  pointer  moves  on  a  horizontal  scale;  the 
subject  has  to  press  a  knob  when  the  pointer  enters  a  warning  zone 
of  the  left  and  right  end  of  the  scale. 

3.  Different  measures  of  heart  rate  and  heart  rate  varablllty  (time 
domain  and  frequency  domain  measures). 

4.  Primary  task  measures  like  steering  reversals,  steering  activity. 

The  feasibility  of  these  Indicators  Is  examined  In  terms  of  reliability, 
validity,  and  freedom  of  Interference.  Results  show  that  the  most  valid 
workload  Indicators  are  the  rating  scale  and  the  secondary  task.  Neverthe¬ 
less,  all  of  them  have  severe  limitations.  In  subsequent  Investigations, 
the  same  workload  Indicators  will  be  measured  In  experiments  with  a  car 
driving  simulator. 

DESCRIPTION  OF  WORK  IN  PROGRESS 

In  our  last  experiments,  different  workload  measures  were  tried  out.  So,  a 
graphic  rating  scale,  a  secondary  task  (monitoring  and  decision  making), 
mean  cardiac  Interval  time,  and  four  measures  of  heart  rate  variability  were 
used  to  assess  mental  workload  In  a  simulated  car  driving  task  and  were 
compared  on  the  basis  of  reliability  and  validity.  The  difficulty  of  the 
car  driving  task  was  varied  In  three  levels  by  changing  the  cut-off  fre¬ 
quency  of  the  forcing  function. 

Tracking  error  In  the  simulated  car  driving  task  significantly  Increased 
with  higher  difficulty  levels.  Graphic  rating  scale  scores  also  Increased 
significantly  with  primary  task  difficulty  levels.  Indicating  that  It  Is  a 
valid  method  for  measuring  workload.  Internal  consistency  of  the  rating 
scale  proved  to  be  satisfactory  as  well. 

Secondary  task  error  as  a  measure  had  a  retest  reliability  good  for  group 
comparisons  but  not  for  Individual  comparisons.  Its  validity  as  a  workload 
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Indicator  was  lower  than  that  of  the  rating  scale.  Of  all  workload  assess¬ 
ment  procedures  used,  cardiac  measures  had  the  highest  retest  reliabilities 
(with  the  exception  of  one  variable).  However,  the  validity  of  the  cardiac 
variables  as  workload  Indicators  was  low.  Only  one  measure  of  heart  rate 
variability  differentiated  approximately  as  well  as  the  secondary  task's 
scores. 

Now  we  are  planning  new  experiments  where  we  use  a  secondary  task  based  on 
psychophysical  methods. 

Qualy,  Judl 

Crew  Systems  (2-3755) 

Boeing  Aeospace  Company 
P.0.  Box  3999,  Mall  Stop  41-08 
Seattle,  Washington  98124 
Ph.  (206)  655-3963 

TEST  BATTERY 

The  purpose  of  this  research  project  Is  to  develop  a  test  battery  of  psycho¬ 
logical  and  physiological  measures  In  order  to  evaluate  both  the  level  and 
type  of  workload  found  In  a  flight  deck  environment.  As  the  measures  are 
defined  and  evaluation  methods  developed,  a  series  of  part-task  simulations 
will  be  conducted  to  determine  the  utility  and  sensitivity  of  the  selected 
measures.  Performance  measures  and  time-line  data  will  also  be  collected 
during  the  simulations  to  be  correlated  with  the  workload  data.  All  data 
will  be  used  In  the  development  of  a  workload  assessment  computer  model  for 
preliminary  design  evaluation. 

Rasmussen,  Jens 
RISO  National  Laboratory 
Electronics  Department 
DK-4000  Roskllde 
Denmark 

PERFORMANCE  EVALUATION  IN  TRAINING  SIMULATORS 

The  purpose  of  the  project  Is  to  develop  a  method  for  observation  and 
analyses  of  operator  performance,  which  can  provide  data  on  decision  making 
In  critical  situations.  One  condition  Is  that  the  observations  must  not 
disturb  the  normal  use  of  the  training  simulator,  or  Interfere  with  the 
Instructor's  normal  work.  This  will  make  It  possible  to  collect  data  from  a 
large  number  of  highly  realistic  situations  with  stress  and  high  mental 
workload.  The  observations  are  based  on  a  detailed  description  of  the 
expected  performance,  which  Is  used  to  detect  discrepancies  (faults  and 
mistakes  in  the  performance).  The  analysis  is  based  on  the  general  decision 
model  and  performance  analysis  principles  developed  at  RISO  and  used  In  a 
considerable  number  of  International  projects.  The  results  from  the  pilot 
test  support  the  usefulness  of  the  approach. 


69 


/ 


Reid,  Gary  B. 

AFAMRL/HEG 
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Ph.  (513)  255-2252 

SUBJECTIVE  WORKLOAD  ASSESSMENT  TECHNIQUE  (SWAT) 

There  are  a  number  of  reasons,  both  theoretical  and  practical,  why  any 
complete  workload  test  battery  should  Include  a  subjective  measurement  tech¬ 
nique.  Also,  a  need  exists  for  a  subjective  measure  that  has  been  system¬ 
atically  developed  and  evaluated  so  that  It  can  be  generally  applied  In 
various  situations.  SWAT  Is  being  developed  as  a  candidate  generalized 
measure.  SWAT  Is  based  upon  a  conceptualization  of  workload  as  a  multi¬ 
dimensional  concept.  Three  dimensions  (time  load,  mental  effort,  and 
psychological  stress)  are  defined.  Conjoint  measurement  is  used  to  define 
the  combination  rule  used  by  subjects  In  ordering  descriptors  for  all  pos¬ 
sible  combinations  of  levels  of  the  three  factors.  Conjoint  scaling  Is  then 
used  to  establish  a  scale  which  conforms  to  the  combination  rule  and  main¬ 
tains  the  ordinal  structure  of  the  original  data.  The  result  of  this  pro¬ 
cedure  Is  an  Interval  level  workload  scale  for  application  to  specific 
events  of  Interest  to  an  Investigator. 

SWAT-1,  a  three-level  version.  Is  available.  Data  demonstrating  validity 
and  reliability  have  been  obtained.  SWAT-2,  a  five-level  version.  Is  being 
developed  to  provide  a  scale  with  finer  discriminations. 

Rohmert,  Walter 
Hochschule  Darmstadt 

Instltut  fur  Arbeltswlssenschaft  der  Technlschen 

Petersenstr.  30 

6100  Darmstadt 

Federal  Republic  of  Germany 

Ph.  06151/162987 

EFFECTS  OF  NEW  TECHNOLOGIES  IN  OFFICE  WORK 
THESIS 

The  Introduction  of  new  technologies  Is  accompanied  by  a  shift  of  demands. 
Demands  and  workload  will  change  in  the  areas  of: 

•  Energy 

•  Information 

•  Organization 

•  Equipment 

•  Work  Place 

•  Environment 
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The  composition  of  demands  has  to  be  designated  with  respect  to  human 
possibilities  and  limitations. 

METHODS 

•  Ergonomic  Job  Description  Questionnaire 

•  Performance  Measures 

•  Physiological  Measures  (electromyogram,  electroocculogram,  heart 

rate,  arrhythmia) 


CLASSIFICATION  OF  W0RKL0A0  BY  ANALYSIS  OF  DEMANDS 
Thesis 

Evaluation  workload  should  be  analyzed  together  with  task-oriented  work¬ 
loads.  Typical  combinations  of  workload  factors  are  to  be  described  to 
point  out  areas  for  further  research. 

Methods 

e  Ergonomic  Job  Description  Questlonnnalre 

a  Cluster  Analysis 

e  Factor  Analysis 

e  Demand  Profiles 

REDUCTION  OF  WORKLOAD  BY  ERGONOMIC  KEYBOARD  DESIGN 

Thesis 


Static  and  dynamic  workload  may  be  reduced  through  an  ergonomic  design  of 
keyboards. 

Methods 

•  Performance  Measures  (lateral /contralateral  keying) 

•  Physiological  Measures 

•  Literature  Research 

SUPERPOSITION  OF  CLIMATE  AND  INFORMATORY  WORK 
Thesis 

Performance  and  physiological  homeostasis  vary  with  climatic  and  Informatory 
workload.  Recovery  periods  will  depend  on  composition  of  workload  factors. 
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Methods 


•  Performance  Measures 

•  Physiological  Measures 

•  Subjective  Rating 

<*  Model  Development  for  the  Estimation  of  Recovery  Periods 

NEW  TECHNOLOGIES  IN  TEXT  PROCESSING  AND  THEIR  IMPACT  ON  MAN  (1979-1981) 

Abstract— New  technologies  are  classified  due  to  their  degree  of 
automatization.  In  field  studies  task  analysis  Is  conducted  in  different 
branches  of  Industry  and  administration"  Tasks  are  clustered  to  similar 
groups  of  job  demands.  For  these  groups,  data  of  stress-strain  measurements 
over  8  hours  were  recorded  and  assessed.  Unfavorable  job  demands  could  be 
i sol ated  and  proposals  for  designs  could  be  given. 

ANALYSIS  AND  DESIGN  OF  CONTROL-TASKS  IN  A  TV  STATION  (1980-1981) 

High  job  demands  (perception,  communication,  static  work,  working  hours, 
climate)  were  isolated  for  different  jobs,  based  on  physical  and  electro- 
physiologic  measurements  as  well  as  subjective  rating,  a  new  design  for  the 
control  tasks  was  proposed. 

ERGONOMIC  DESIGN  OF  KEYBAORDS  (1979-1981) 

Material  of  keyboard  design  was  collected  from  literature.  Literature  was 
coded  and  stored  In  an  information  and  documentation  system.  Laboratory 
research  on  stress  reactions  due  to  design  parameters  lead  to  design 
proposals  for  typewriter  keyboards. 

SUPERPOSITION  OF  INFORMATORY  WORK  AND  CLIMATIC  STRESS  (1977-1982) 

Performance  and  strain  reactions  were  recorded  during  superposition  of 
stress  factors.  Maximal  endurance  limits  could  be  laid  down.  With  regard 
to  physiologic  measures  and  endurance  limits,  rest  periods  can  be  proposed 
depending  on  (1)  difficulty  of  informatory  work,  (b)  climatic  stress,  and 
(c)  duration  of  work. 

SUPERPOSITION  OF  INFORMATORY  WORK  AND  VIBRATION  (1976-1982) 

For  crane  driving  tasks  on  a  simulator  and  superimposed  vibrations,  maximal 
endurance  limits  are  laid  down.  Rest  periods  with  regard  to  performance  and 
strain  will  be  derived.  The  results  will  be  validated  In  field  studies. 


72 


Roscoe,  Alan  H. 

Medical  Department 
Royal  Aircraft  Establishment 
Bedford,  England  MK41  6AE 
Ph.  0234  55241,  Ext.  8536 

HEART  RATE  MEASURES 

A  pilot’s  heart  rate  is  monitored  routinely  during  flight  trial  at  Bedford 
where  workload  estimation  is  an  Important  requirement.  Results  are  used 
primarily  to  augment  a  pilot's  subjective  opinion  and  to  identify  rapid  or 
short-term  changes  in  levels  of  workload.  Current  flight  trials  include 
evaluation  of  approach  aids  for  Sea  Harrier,  Category  3  approaches  and 
landings,  and  head-up  display. 

A  recently  introduced  rating  scale  based  on  the  Cooper-Harper  Handling 
Qualities  rating  scale  is  being  used  and  ratings  from  a  number  of  flight 
tasks  compared  with  heart  rate.  Early  results  are  encouraging. 

Further  research  into  the  value  of  heart  rate  as  a  measure  of  aircraft 
handling  workload  is  being  undertaken  on  an  "opportunity  basis."  Three 
different  types  of  high  performance  aircraft  are  being  compared  for  workload 
during  approach  and  landings  and  during  formation  flying.  Test  pilots  fly 
each  type  and  rate  the  workload  for  comparison  with  their  heart  rates. 

Rouse,  William  B. 

Department  of  Mechanical  and  Industrial  Engineering 
University  of  Illinois 
Urbana,  Illinois  61801 
Ph.  (217)  333-7474 

We  have  no  projects  in  mental  workload.  However,  several  of  our  flight 
management  studies  have  included  mental  workload  in  models  and/or  measure¬ 
ments.  Workload  is  only  one  aspect  of  our  overall  objectives. 

Sanders,  A.  F. 

Institute  for  Perception 
T.N.O. 

Kampweg  5 

Soesterberg,  The  Netherlands 
Ph.  3463  1444 

Research  is  undertaken  on  joint  performance  of  several  tasks  at  once;  and 
the  properties  of  the  tasks,  allowing  or  prohibiting  simultaneous  perform¬ 
ance,  are  studied. 

Research  is  undertaken  and  the  feasibility  of  the  P3  component  of  the  Evoked 
Potential  (EP)  as  a  measure  of  workload  during  automobile  driving  Is 
assessed.  The  EP  is  obtained  to  a  signal  counting  task,  carried  out  while 
driving. 
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Schiflett,  Sam  6. 

Aircrew  Systems/Human  Factors 
Naval  Air  Test  Center 
Mail  Code  SY721 

Patuxent  River,  Maryland  20670 

Ph.  (301)  863-4157  (AUTOVON  8-356-4157) 

WORKLOAD  MEASUREMENT  METHODOLOGY  CATALOG 

The  contractor  conducted  a  comprehensive  state-of-the-art  survey  and 
analysis  of  operator  workload  measurement  methodology,  research,  and  appli¬ 
cations.  The  effort  included  a  critical  evaluation  of  the  relationships 
between  operator  workload  measurement  requirements  in  aircrew  systems  and  a 
catalog  of  available  methodologies.  The  results  of  this  effort  are  a  signi¬ 
ficant  factor  in  the  future  planning  of  RDT&E  objectives  In  support  of  air¬ 
crew  workload  measurement  requirements. 

WORKLOAD  ASSESSMENT  DEVICE  (WAD) 

The  contractor  designed,  fabricated,  installed,  and  functionally  checked  out 
a  workload  assessment  device  to  measure  and  analyze  operator  workload  levels 
in  flight.  The  effort  included  development  of  system  hardware,  software, 
and  task  procedures  to  collect  and  analyze  data  utilizing  an  item  recogni¬ 
tion  task  previously  developed  for  the  Air  Force  (AFAMRL).  The  device  Is 
presently  Installed  In  an  NT-33A  aircraft  for  in-flight  display  evaluations 
on  the  Display  Evaluation  Flight  Test  (DEFT)  Program. 

ANNOTATED  BIBLIOGRAPHY  OF  OPERATOR  WORKLOAD 
ASSESSMENT  TECHNIQUES 

In  an  attempt  to  review  and  select  the  appropriate  technique  to  measure 
operator  workload  levels  in  aircrew  systems,  a  survey  and  analysis  of 
available  workload  measurement  methodologies  was  conducted  by  Systemetrics, 
Incorporated,  under  Contract  N00421-77-C-0083.  A  first  report  entitled, 
“Survey  and  Analysis  of  Operator  Workload  Assessment  Techniques,"  was  Issued 
in  September  1978.  The  report  contained  a  bibliography  of  over  400  docu¬ 
ments  related  to  TSE  techniques.  The  purpose  of  this  procurement  is  to 
develop  a  companion  report  containing  an  updated  bibliography  of  abstracted 
workload  techniques.  The  annotated  bibliography  will  be  used  as  a  cross- 
reference  index  for  selecting  candidate  aircrew  workload  assessment  measures 
for  in-flight  evaluation  of  man-machine  systems.  The  proper  use  of  the 
bibliography  will  Impact  the  test  and  evaluation  of  all  current  and  future 
military  aircraft. 

VOICE  STRESS  ANALYSIS 

The  project  will  develop  an  automated  measure  of  stress  based  on  voice 
analysis,  which  will  be  appropriate  for  human  performance  tasks  involved  In 
aviation,  and  which  can  be  used  without  attaching  equipment  to  a  performer. 
Initial  research  has  shown  the  feasibility  of  a  vocal  measure  using  a  com¬ 
mercial  instrument,  the  Psychological  Stress  Evaluator  (PSE).  The  present 
project  will  (1)  automate  the  procedure  used  in  PSE  analysis;  (2)  upgrade 
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this  procedure  through  testing  of  relevant  field-data  against  original  labo¬ 
ratory  data  (Involving  a  standard  workload  task);  and  (3)  test  the  resulting 
measure  on  vocal  data  from  projects  at  NASA/Ames  and  the  NAVAIRTESTCEN. 

VOICE  STRESS  ANALYSIS  AS  A  MEASURE 
OF  OPERATOR  WORKLOAD 

This  study  attempted  to  determine  if  the  PSE  could  be  used  to  detect  the 
amount  of  situational  stress  in  the  voice  while  subjects  performed  a  four- 
choice  information  processing  task  at  different  presentation  rates.  The  42 
subjects  were  divided  into  Group  I— Jet,  Group  II— Prop,  and  Group  Ill- 
Staff.  A  Response  Analysis  Tester  (RATER)  presented  a  four-choice  discrimi¬ 
nation  task  in  which  the  subjects  were  required  to  match  a  response  key  to 
each  of  four  stimuli  (Numbers  1,  2,  3,  and  4)  appearing  in  a  display  window. 
The  sequence  of  stimuli  was  randomly  presented  in  an  automatic-paced  mode 
for  nine  1-minute  tests.  The  stimuli  presentation  rates  were  set  at  one 
symbol  per  1.5  seconds,  0.75  second,  and  0.50  second.  During  the  first 
three  tests,  the  subjects  were  instructed  to  press  the  correct  key  and  not 
verbalize  the  number.  During  the  next  three  tests,  the  subjects  verbalized 
the  number  and  simultaneously  pressed  the  correct  key.  At  the  end  of  each 
block  of  three  tests,  the  subjects  estimated  self-performance  as  percent 
correct  and  rated  stress  on  a  scale  of  1  (no  stress)  to  7  (high  stress). 
Voice  signals  were  initially  recorded  on  magnetic  tape,  then  processed 
through  filtering  circuits  and  displayed  on  a  strip  chart  for  subsequent 
visual  analysis  and  interpretation.  A  subjective  scoring  criterion  was 
established  and  then  translated  into  electronic  equivalents  and  automated  on 
a  Varian  73  computer  for  voice  pattern  recognition  analysis.  Significant 
main  effects  for  percent-correct  response  were  obtained  for  groups,  presen¬ 
tation  rate,  and  groups  X  presentation  rate  interaction.  No  significant 
differences  were  found  in  the  correct  responses  of  the  subjects  when  the 
number  was  verbalized  or  not  verbalized.  The  Staff  group  produced  signifi¬ 
cantly  fewer  correct  responses  than  either  the  Jet  or  Prop  groups  at  the 
0.75  second  rate.  Voice  stress  analysis  showed  significant  correlations 
with  performance  scores  and  stress  ratings  of  a  selected  pool  of  subjects 
(N  =  12).  The  results  were  discussed  as  to  the  potential  application  of  an 
objective,  reliable,  sensitive,  and  nonobtrusive  measure  of  stress  in  vocal 
communication  systems  that  require  operator  workload  assessments. 

EVALUATION  OF  A  PILOT  WAD  TO  TEST  ALTERNATE 
DISPLAY  FORMATS  AND  CONTROL  STABILITY  VARIATIONS 

This  in-flight  research  project  evaluated  the  utility  of  a  WAD  to  measure 
pilot  workload  for  approach  and  landing  tasks  under  simulated  Instrument 
meterologlcal  conditions,  alternate  Head-Up  Display  (HUD)  formats,  and  con¬ 
trol  stability  variations.  The  flight  tests  were  conducted  in  an  NT-33A 
research  aircraft,  extensively  modified  for  the  Air  Force  and  Navy  by  the 
Display  Evaluation  Flight  Test  Program.  The  hardware,  software,  and  test 
procedures  associated  with  the  WAD  function  efficiently  with  only  minor 
descriptions  and  minimum  pilot  distraction.  The  project  established  the 
feasibility  of  using  an  item  recognition  task  as  a  measure  of  sensory- 
response  loading  and  reserve  information  processing  capacity  while  flying 
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precision  approaches.  The  results  Indicate  an  appreciable  Increase  In  reac- 
tlon  time  and  errors  on  the  secondary  task  flown  with  degraded  handling 
qualities  as  compared  to  ground  baseline  measures  and  good  handling  quali¬ 
ties.  The  pilots  showed  more  mental  reserve  capacity  when  flying  pictorial/ 
symbolic  HUD  configurations,  as  compared  to  conventional  HUD  formats  with 
standard  scales  and  alphanumerics.  It  is  recommended  that  further  evalua¬ 
tions  be  conducted  to  establish  the  efficiency  of  utilizing  the  WAD  to  meas¬ 
ure  mental  workload  In  a  variety  of  aircrew  tasks. 

EVALUATION  OF  A  PILOT  ASSESSMENT  DEVICE  TO  TEST 
ALTERNATE  DISPLAY  FORMATS  FOR  AIRCRAFT  CARRIER  APPROACHES 

This  In-flight  research  study  Is  a  follow-on  project  to  contract  N0042179M- 
3660  to  measure  pilot  workload  for  aircraft  carrier  approach  and  landing 
tasks.  The  flight  tests  were  conducted  at  the  NAVAIRTESTCEN  using  an  Air 
Force  modified  NT-33A  aircraft,  laser  tracking  system  for  time-space- 
position  data,  the  fresnel  lens  guidance  mirror,  and  the  DEFT  programmable 
HUD  graphics.  A  total  of  10  flights  were  flown  by  four  F-18  pilots  using  an 
F-18  based  HUD  and  a  plctoral  Klopfstein  display.  These  data  are  currently 
being  analyzed. 

CROSS-COUPLED  INSTABILITY  TASK  (CCIT) 

The  contractor  will  design,  fabricate,  install,  and  functionally  test  the 
CCIT  to  measure  and  analyze  pilot  workload  levels  in  flight.  The  effort 
will  include  advanced  development  and  production  of  novel  system  hardware, 
software,  and  task  procedures  to  collect  and  analyze  simulation  and  in¬ 
flight  data.  The  advanced  development  CCIT  Is  based  on  an  earlier  prototype 
model  developed  for  the  National  Aeronautics  and  Space  Administration.  The 
CCIT  measures  the  tracking  accuracy  of  the  unloaded  operator,  adjusted  for 
each  Individual's  own  baseline  performance,  and  the  excess  control  capacity 
when  loaded  by  a  selected  combination  of  primary  and  secondary  tasks.  It  is 
planned  that  the  CCIT  will  be  utilized  during  simulation  of  a  precision 
flying  task  Involving  a  control /display  problem  of  sufficient  magnitude 
requiring  excess  operator  loading. 

ADAPTIVE,  CROSS-COUPLED  WAD 

The  WAD  developed  under  a  previous  contract  (Systems  Research  Laboratories, 
Inc.)  will  be  modified  to  provide  options  for  an  adaptive  secondary  task 
that  can  be  cross-coupled  to  select  flight  parameters.  An  added  feature 
will  be  an  expanded  statistical  routine  with  mass  storage  capacity  on  a 
floppy  disk.  A  unique  troubleshooting  software  module  will  provide  In-the- 
fleld  diagnostic  capabilities  via  a  dial-up  modem.  Also,  an  Improved  speech 
synthesizer  will  be  added  to  the  WAD  to  furnish  an  audio  presentation 
through  the  headphones. 
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Senders,  John  W. 

Department  of  Industrial  Engineering 

University  of  Toronto 

Toronto,  Ontario 

Canada  M5S  1A4 

Ph.  (416)  978-6823 

WORKLOAD  DEFINITION 

We  have  been  engaged  In  two  general  programs  In  recent  times.  One  has  been 
concerned  with  the  basic  philosophical  issues  of  the  definition  of  mental 
workload  as  a  conceptual  schema.  Our  effort  has  been  directed  toward  analy¬ 
sis  of  the  modeling  requirements  for  estimation  of  the  load  Imposed  by 
definable  hypothetical  systems  which  can  be  themselves  simulated  on  a  com¬ 
puter  and  operated  by  a  model  of  the  human  operator. 

COMPARISON  OF  SECONDARY  TASK  AND  SUBJECTIVE  METHODS 

At  a  more  pragmatic  level,  we  have  been  making  direct  experimental  compari¬ 
sons  between  secondary  task  methods  and  subjective  estimations  for  some 
simple  tasks  based  on  a  TV  NPongM  same.  The  general  conclusion  seems  to  be 
that  subjective  estimation  by  the  operator  doing  the  task  is  more  consistent 
than  the  measures  obtained  by  secondary  tasks.  Since  the  ultimate  validity 
of  any  technique  is  the  subjective  one,  it  should  be  the  case  that  subjec¬ 
tive  methods  will  prevail  for  field  work  except  in  cases  (labor-management 
problems,  for  example)  where  objective  methods  are  required. 

Sheridan,  Thomas  B. 

Room  I- 110 

Man-Machine  Systems  Lab 
Massachusetts  Institute  of  Technology 
Cambridge,  Massachusetts  02139 
Ph.  (617)  253-2228 

SUBJECTIVE  WORKLOAD  ASSESSMENT  IN  SIMULATED  IFR  FLIGHT 

A  cooperative  project  with  Professor  R.  Simpson  under  FAA/DOT  sponsorship 
had  resulted  in  the  development  of  a  three-dimensional  workload  rating 
scale.  It  is  now  being  evaluated  in  simulation  experiments.  Several 
reports  have  resulted.  Including  a  master's  thesis  by  J.  Katz. 

MENTAL  WORKLOAD  IN  FLIGHT  MANAGEMENT 

Using  an  experimental  multitask  paradigm  developed  by  K.  Tulsa  In  our 
laboratory  several  years  ago,  B.  Daryanlan  has  obtained  subjective  workload 
ratings  for  monitoring/control  tasks  composed  of  27  combinations  of  three 
parameters:  rate  at  which  new  tasks  are  Imposed,  time  available  for  doing 
the  tasks,  and  efficiency  In  doing  the  tasks.  Rate  at  which  new  tasks  are 
Imposed  had  high  correlation  with  subjective  workload;  the  other  factors  had 
none.  This  work  resulted  In  B.  Daryanlan's  master's  thesis. 
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BASIC  RESEARCH  IN  HUMAN  SUPERVISORY  CONTROL 


Includes  mental  workload  as  key  factor  In  performance  of  human-computer- 
system  control.  Funded  by  ONR.  Experimental  techniques  involve  on-line 
computer  simulation  and  computer-mediated  performance  measurement  and  sub¬ 
jective  scaling  in  a  variety  of  contexts. 

Shingledecker,  Clark  A. 

AFAMRL/HEG 

Wright-Patterson  AFB,  Ohio  45433 
Ph.  (513)  255-2252 

SUBSIDIARY  RADIO  COMMUNICATIONS  TASKS 

Due  to  problems  associated  with  primary  task  intrusion  and  operator 
acceptance,  many  secondary  task  methods  of  assessing  operator  workload  are 
difficult  to  employ  during  the  later  stages  of  aircraft  system  development. 
In  order  to  develop  a  secondary  task  methodology  appropriate  for  high 
fidelity  simulation  and  in-flight  test,  the  concept  of  using  performance  on 
subsidiary  radio  communications  tasks  as  a  measure  of  workload  Is  presently 
under  evaluation.  Communications  activities  are  an  integral  part  of  an 
aircrew  member's  task  environment  and  are  normally  assigned  a  priority  which 
Is  high  yet  secondary  to  other  flight  duties.  Furthermore,  the  verbal  and 
manual  responses  to  radio  messages  are  easily  recorded  and  experimentally 
separable  from  other  activities.  Analytical,  subjective,  and  hybrid  scaling 
techniques  have  been  employed  to  estimate  the  loading  associated  with 
realistic  communications  tasks  derived  from  Interviews  with  combat  pilots. 
Performance  evaluations  are  presently  underway  to  assess  the  sensitivity  of 
these  tasks  to  rudimentary  flight  control  workload  and  to  generate  criterion 
measures  for  evaluation  of  the  a  priori  scaling  results.  The  results  of 
this  effort  will  be  used  to  develop  guidelines  for  the  design  of  secondary 
communications  tasks  tailored  to  specific  system  and  mission  contexts. 

EVALUATION  OF  THE  INTERVAL  PRODUCTION  TASK 

Mlchon's  (1966,  Ergonomics)  Interval  production  task  yields  a  workload 
measure  which  has  received  little  recent  experimental  attention.  The  IPT 
requires  subjects  to  generate  a  continuous  series  of  time  Intervals  by 
emitting  a  motor  response  at  a  consistent  rate  within  the  limits  of  one  to 
three  responses  per  second.  The  variability  of  Interval  duration  Is  used  as 
an  Index  of  primary  task  workload.  The  task  Is  Inherently  simple,  requires 
no  sensory  Input,  and  offers  a  variety  of  possible  response  modes.  Conse¬ 
quently,  the  IPT  should  minimize  primary  task  Interference.  A  further  ad¬ 
vantage  Is  that  the  IPT  does  not  seem  to  act  as  a  reserve  capacity  secondary 
task.  Instead,  It  appears  to  Index  load  In  a  manner  analogous  to  physio¬ 
logical  metrics.  In  a  current  effort,  the  IPT  Is  being  evaluated  for  sensi¬ 
tivity  to  loading  In  both  perceptual  and  motor  dimensions.  Alternate 
response  modalities  are  also  under  Investigation.  Preliminary  results  Indi¬ 
cate  that  the  IPT  produces  little  Interference,  Is  sensitive  to  task  demand, 
and  can  track  changes  in  workload  produced  by  shifts  In  operator  strategy. 
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METRIC  EVALUATION  PROGRAM 


A  sub-element  of  the  AFAMRL  workload  program  has  been  established  to  Improve 
methods  of  assessing  the  utility  of  proposed  secondary  tasks  and  subjective 
workload  metrics.  The  program  Is  presently  focused  on  the  development  of  a 
standardized  set  of  primary  tasks  selected  on  the  criteria  of  being  repre¬ 
sentative  both  of  tasks  which  exist  In  Air  Force  systems  and  of  the  multiple 
dimensions  of  cognitive  activity  in  which  the  human  information  processing 
system  engages.  The  primary  task  set  will  be  used  to  determine  the  types  of 
tasks  and  mental  functions  a  particular  candidate  metric  can  assess,  its 
relative  sensitivity  to  loading  in  those  dimensions,  and  the  degree  to  which 
it  interferes  with  primary  task  performance.  Standard  experimental  method¬ 
ology  and  statistical  analysis  techniques  are  also  being  designed  to  permit 
timely,  thorough,  and  comparable  evaluations  to  be  performed  on  any  of  a 
variety  of  proposed  workload  measures. 

Siegel,  Arthur  I. 

Applied  Psychological  Services 
404  East  Lancaster  Avenue 
Wayne,  Pennsylvania  19087 
Ph.  (215)  688-4874 

PROJECT  I 

This  project  emphasizes  quantitative  methods  for  assessing  intellective 
overload.  The  human  transfer  function  is  measured  in  a  psychophysical  work¬ 
load  context  to  determine  individual  load  carrying  capacity  and  intellective 
load  carrying  threshold. 

PROJECT  II 

The  intellective  load  placed  on  the  operator  of  a  system  is  measured  to 
assess  areas  (in  system  employment)  of  operator  overload  and  underload.  The 
results  are  used  to  derive  areas  of  needed  system  redesign/modification. 

PROJECT  III 

The  contribution  of  cognitive  stress  to  intellective  overload  is  assessed 
along  with  other  variables  such  as  shift  length,  work-rest  cycle,  group 
factors,  diurnal  rhythm,  etc.  The  result  is  a  measure  of  anticipated  per¬ 
formance  degradation  due  to  these  factors. 
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Soede,  Mathljs  Or  Ir 

NIPG  Netherlands  Institute  for  Preventive  Healthcare 

NTNO  Netherlands  Organization  for  Applied  Scientific  Research 

Wassenaarseweg  56 

Leiden,  Netherlands  2333AL 

Ph.  071-150940 

WORKLOAD  MODEL 

A  paper  has  been  written  to  present  some  reflections  about  the  problem  of 
mental  load  and  the  measurement  of  the  level  of  mental  load.  A  general 
model  of  the  relation  between  mental  control  effort  and  performance  is 
given.  Some  connotations  are  made  regarding  the  notion  of  mental  capacity. 

The  model  proposed  is  suggested  to  be  applicable  in  the  particular  man- 
machine  situation  of  an  arm  amputeed  patient  using  a  prosthesis.  Pilot 
experiments  with  the  aim  to  develop  methods  to  measure  the  control  effort  In 
using  a  prosthesis  is  given  as  an  example  of  the  application  of  mental  load 
measures. 

At  the  end  of  this  paper  some  questions  are  raised  as  to  the  factors  which 
may  restrain  progress  in  mental  research. 

Stein,  Earl  (coworkers  J.  Fabry  and  B.  Rosenberg) 

Federal  Aviation  Administration  Technical  Center 
P.0  Box  25082 

Oklahoma  City,  Oklahoma  73125 

THE  ELUSIVE  GOAL  OF  MEASURING  PILOT  WORKLOAD 
IN  GENERAL  AVIATION 

The  multidimensional  nature  and  complexity  of  tasks  Involved  In  piloting  a 
modern  aircraft  are  well  known  in  the  aviation  field.  What  has  been  unclear 
and  remains  so  is  how  to  reliably  measure  both  pilot  workload  and  perform¬ 
ance,  which  may  well  be  different  edges  of  the  same  sword. 

The  approach  of  the  Federal  Aviation  Administration  (FAA)  Technical  Center 
toward  these  concepts  Involves  developing  the  tools  necessary  In  order  to 
evaluate  the  impact  of  systems  changes  in  general  aviation  aircraft.  The 
primary  question  to  be  answered  Is  whether  or  not  changes  will  affect  the 
behavior  of  human  operators.  Currently  the  workload/ performance  effort  Is 
being  made  under  a  program  titled  "The  Cockpit  Display  of  Traffic 
Information." 

Research  Is  proceeding  based  on  a  pragmatic  rather  than  highly  theoretical 
measurement  philosophy.  It  Is  assumed  that  traditional  postflight  question¬ 
naire  techniques  may  have  been  necessary,  but  Insufficient  Indicators  of 
pilot  workload  and  a  more  viable  "real-time"  method  are  required.  It  Is 
also  assumed  that  many  of  the  distinctions  that  have  been  made  In  the 
literature  concerning  types  of  m eau remen t  have  often  artificially  dichoto¬ 
mized  variables.  For  example,  referring  to  all  questionnaire  and  rating 
scale  techniques  as  totally  subjective  Ignores  levels  of  subjectivity  and 
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objectivity  which  can  vary  based  on  experimental  methods  and  procedures.  We 
assume  that  If  a  pilot  Is  asked  In  a  systematic  fashion  how  hard  he/she  Is 
working,  the  response  will  be  a  holistic  one.  The  pilot  will  not  discrimi¬ 
nate  between  Internal  physiological/psychological  processes  and  overtly 
physical  tasks  of  manipulating  the  aircraft. 

Based  on  this  monatomlstlc  measurement  philosophy,  a  series  of  experiments 
has  begun  to  determine  if  people  are  willing  and  able  to  make  workload  judg¬ 
ments  during  the  course  of  primary  task  performance.  A  goal  has  been  set  to 
establish  a  series  of  measures  along  continuums  of  objectivity  and 
subjectivity. 

The  first  experiment  in  the  series  employed  a  nonflying,  critical  tracking 
task  in  which  both  pilot  and  nonpilot  groups  were  asked  to  maintain  a  point 
of  light  In  the  center  of  a  CRT  display.  During  the  task,  participants  were 
queried  every  minute  by  a  tone  and  were  told  to  respond  by  pressing  one  of 
an  array  of  10  buttons  to  provide  a  workload  assessment  ranging  from  one 
(very  easy)  to  10  (very  hard).  This  was  considered  the  more  subjective 
measure  while  response  latency  was  the  more  objective  measure.  Four  task 
difficulty  levels  had  been  established  and  were  administered  in  a  counter¬ 
balanced  design.  Results  indicated  that  workload  judgments  corresponded 
very  well  to  the  four  difficulty  levels.  Although  responding  during  task 
performance  was  somewhat  obtrusive,  participants  were  able  to  respond  with¬ 
out  a  noticeable  decrement  In  performance. 

The  second  experiment  introduced  a  "flying-  task  using  a  Link  general 
aviation  trainer  (GAT).  Three  levels  of  difficulty  were  designed  by  varying 
the  initial  clearance  complexity,  the  level  of  air  traffic  control,  and 
In-flight  emergency.  A  digital  computer  was  employed  to  query  the  pilot 
through  presentation  of  a  tone  and  to  record  responses  and  latencies.  Both 
these  variables  were  significantly  different  across  the  three  levels  of 
difficulty.  Pilots  were  again  able  and  willing  to  make  these  judgments 
during  flight.  A  task  frequency  tally  showed  that  there  were  two  areas  of 
pilot  behavior  which  Increased  In  frequency  as  difficulty  Increased.  These 
were  communication  and  navigation. 

This  experiment  was  dependent  on  a  fixed  minicomputer  for  workload  data 
collection.  Plans  for  the  future  involve  using  a  microcomputer  In  an  air¬ 
borne  configuration  to  provide  query  probes  and  collect  data  from  pilot/ 
copilot  and  an  observer  through  input  keyboards  designed  for  that  purpose. 

Performance  research  Is  just  beginning  at  the  FAA  Technical  Center.  It  will 
be  based  upon  a  mixture  of  Automated  Performance  Measurements  (APM)  and 
traditional  Instructor  pilot  checklist/rating  scale  methods.  An  Instru¬ 
mented  GAT  will  be  capable  of  recording  79  aircraft  status  and  control 
parameters  at  a  sampling  rate  of  once  per  second.  Initial  studies  will 
attempt  to  establish  composite  measures  which  will  separate  pilots  based  on 
their  experience  and  training.  This  will  hopefully  lead  to  measures  of 
performance  on  a  continuum  suitable  for  general  aviation  applications. 
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BIOCYBERNETICS 

Objectives  for  this  project  focus  on  study  and  evaluation  of  brain  electri¬ 
cal  activity  (both  transient  and  steady-state  responses)  for  use  as  metrics 
in  workload  assessment  and  for  rudimentary  hands-off  display  quality  optimi¬ 
zation.  For  the  first  objective,  sensitivity  of  the  brain-evoked  responses 
to  sensory  and  cognitive  parameters,  especially  reflected  in  amplitude  and 
phase  changes,  will  be  analyzed  to  determine  usefulness  of  the  measures  as 
aids  in  display  design  and  subsystem  evaluation.  Alerting  and  warning  sys¬ 
tems  will  receive  emphasis;  discrete  presentation  of  the  warnings  will  pro¬ 
vide  stimuli  for  transient-evoked  responses  to  determine  how  the  information 
is  utilized  by  the  pilot  (i.e.,  whether  It  is  acknowledged.  Ignored,  pro¬ 
cessing  characteristics,  etc.).  Analysis  of  the  sensory,  cognitive,  and 
motor  parameters  of  the  alerting  and  warning  information  systems  will  be 
conducted  to  determine  which  combinations  of  parameters  effect  optimal 
utilization  of  the  displayed  Information.  The  purpose  of  this  investigation 
is  to  validate  the  psychophysiological  measurement  techniques  in  other  than 
a  laboratory  environment  and  to  compile  a  design  guide  matrix  which  will 
enable  the  technique  to  be  used  during  the  design  process. 

The  second  objective  focuses  on  the  steady-state  response.  Steady-state 
brain  electrical  activity,  evoked  through  sinusoidal  modulation  of  display 
intensity,  will  be  used  for  on-line  monitoring  of  display  Image  quality 
(Intensity,  contrast,  etc.).  In  addition,  an  automatic  feedback  control 
system  will  be  developed  which  will  alter  display  image  qualities  based  on 
evoked  response  characteristics. 

Tole,  John  R. 

Worcester  Polytechnic  Institute 
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QUALIFICATION  OF  PILOT  WORKLOAD  VIA  INSTRUMENT  SCAN 

The  following  describes  work  In  progress  on  the  use  of  visual  scanning 
behavior  as  an  Indicator  of  pilot  workload.  The  study  Is  Investigating  the 
relationship  between  level  of  performance  on  a  piloting  task,  the  skill  of 
the  pilot,  the  level  of  mental  workload  Induced  by  an  additional  verbal  task 
Imposed  on  the  basic  control  task,  and  visual  scanning  behavior.  The  basic 
control  task  Involved  maintaining  a  general  aviation  flight  simulator  on  a 
straight  and  level,  constant  sensitivity.  Instrument  Landing  System  (ILS) 
course  with  a  low  level  of  turbulence.  A  task  employing  an  algorithm  based 
on  relative  magnitudes  of  a  sequence  of  numbers  was  used  to  increment  the 
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subject's  mental  workload.  The  level  of  loading  for  various  conditions  was 
also  estimated  In  an  Independent  series  of  runs  using  a  side  task.  The 
subject's  lookpolnt  on  the  Instrument  panel  during  each  ten-minute  run  was 
computed  via  a  TV  oculometer  and  stored.  A  total  of  13  pilots  of  varying 
skill  participated  In  two  sets  of  experiments. 

The  results  Indicate  an  Increase  In  fixation  dwell  times,  especially  on  the 
primary  Instrument,  with  Increased  mental  loading  task.  The  amount  of 
“staring"  observed  appears  to  depend  on  the  level  of  skill  of  the  pilot; 
skilled  subjects  appear  to  stare  less  under  Increased  loading  than  do  novice 
pilots.  Sequences  of  Instrument  fixations  were  also  examined.  The  per¬ 
centage  occurrence  of  the  subject's  most  used  sequences  decreased  with 
increased  task  difficulty  for  novice  subjects  but  not  for  highly  skilled 
subjects. 

Analysis  of  the  periodicity  of  the  subject's  instrument  scan  was  accom¬ 
plished  using  autocorrelation.  Skilled  pilots  were  found  to  scan  their 
primary  instrument  in  a  periodic  fashion.  The  period  was  related  to  the 
interval  between  number  task  presentation.  A  similar  result  was  not 
observed  in  novice  pilots.  This  finding  suggests  that  skilled  pilots  may 
handle  the  additional  loading  task  in  a  much  more  systematic  fashion  than  do 
novice  pilots. 

Entropy  rate  (bits/sec)  of  the  sequence  of  fixations  was  also  used  to 
quantify  the  scan  pattern.  It  consistently  decreased  for  most  subjects  over 
the  four  loading  levels  used.  An  exponential  equation  in  task  difficulty 
was  found  to  be  a  good  predictor  of  entropy  rate.  When  solved  for  task 
difficulty,  the  equation  provided  an  estimate  of  the  level  of  task  diffi¬ 
culty  perceived  by  a  subject.  This  estimate  was  used  to  quantify  the  work¬ 
load  of  the  subject. 

Piloting  and  number  task  performance  measures  were  recorded  and  a  combined 
performance  measure  was  computed.  This  was  used  In  developing  a  model 
relating  performance,  skill,  and  mental  workload.  Entropy  rate  of  the  scan 
was  used  to  quantify  the  workload  and  skill  was  estimated  Independently  via 
a  method  based  on  pilot  experience.  The  resulting  exponential  model  fit  the 
data  well  enough  to  suggest  that  this  approach  has  promise  in  the  valuation 
of  Interactions  among  these  variables. 

Wlckens,  Christopher  0. 

Department  of  Psychology 
University  of  Illinois 
Champaign,  Illinois  61820 
Ph.  (217)  333-6195 

TASK  INTEGRATION  AND  WORKLOAD  ASSESSMENT: 

APPLICATIONS  OF  A  STRUCTURE-SPECIFIC  RESOURCES 
MODEL  OF  HUMAN  INFORMATION  PROCESSING 

This  Is  a  programmatic  effort  to  relate  theoretical  models  of  attention  to 
measures  of  task  workload,  and  guidelines  for  integrating  tasks  in  complex 
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environments.  The  model  we  adopt  (and  are  validating)  Is  a  multiple 
resource  model  that  assumes  attention  Is  not  scalar  but  a  vector  quantity 
where  dimensionality  Is  defined  by  two  stages  of  processing,  two  codes  of 
processing  (verbal  versus  spatial),  and  by  processing  modalities.  With 
regard  to  workload,  we  ask  how  task  demands  Imposed  upon  the  various  atten- 
tlonal  resources  In  combination  concatonate  to  generate  single  scalar  meas¬ 
ures  of  workload  (subjective  ratings,  heart  rate  variability,  primary  task 
performance);  and  how  measures  of  single  task  workload  predict  task  perform¬ 
ance  In  combination.  With  regard  to  task  Integration,  we  demonstrate  how 
options  In  task  design  that  utilize  separate  resources  (e.g.,  spatial 
coding,  auditory  displays,  and  speech  output),  can  Improve  the  efficiency  of 
dual  task  performance. 

THE  EVENT  RELATED  BRAIN  POTENTIAL  AS  AN  INDEX 
OF  ATTENTION  ALLOCATION  AND  TASK  WORKLOAD 

This  effort  focuses  on  the  unique  Information  that  the  event-related  brain 
potential  can  provide  concerning  (1)  the  locus  of  processing  demands  of  a 
concurrent  task  within  a  multiple-resource  conception,  (2)  the  allocation 
of  attention  to  events  In  complex  auditory  and  visual  displays.  The  term 
"unique"  stresses  the  extent  to  which  Information  derived  from  the  ERP  Is 
unavailable  from  conventional  manual  and  vocal  responses.  This  Is  a  part  of 
a  longer  programmatic  effort  by  the  Cognitive  Psychophysiology  Laboratory 
concerning  the  contributions  of  the  ERP  to  advances  In  human  engineering. 
Research  support  has  been  provided  by  ARPA,  Air  Force  AMRL  and  OSR. 

DISSOCIATION  EFFECTS/SECONDARY  STERNBERG  TASKS 

At  Illinois,  we  are  continuing  our  efforts  to  compare  behavioral  (Sternberg 
task)  and  physiological  (event-related  potential  and  sinus  arryhthmla)  work¬ 
load  measures  with  each  other,  and  with  subjective  workload  estimates  In  a 
variety  of  settings.  One  Issue  focuses  on  the  dissociation  between  subjec¬ 
tive  measures  and  secondary  task  measures,  l.e.,  what  does  It  mean  when  two 
conditions  are  discriminated  by  one  measure  but  not  by  the  other?  We 
observe  such  dissociation  when  we  compare  workload  changes  Induced  by  adding 
more  tasks  and  by  Increasing  the  difficulty  of  a  single  task. 

A  second  Issue  concerns  the  exploration  of  the  Sternberg  task  as  a  secondary 
task  workload  Index.  We  are  Interested  In  the  Information  provided  by  slope 
and  Intercept  measures  of  the  Sternberg  RT  function  and  the  way  In  which 
these  relate  to  "central  processing,"  Input  and  output  load.  In  particular, 
we  have  examined  several  applications  of  this  task  to  flight  workload  and 
noted  the  prevalence  of  decreasing  slopes  with  additional  task  workload. 
This  somewhat  counter-intuitive  result,  we  believe,  may  be  a  consequence  of 
(1)  the  Input/output  modality  of  the  task  employed  (auditory/vocal  versus 
vl sual /manual ) ,  and  (b)  the  mismatch  between  a  primarily  spatial  flight 
task,  and  a  verbal -languaged-based  Sternberg  task  (letter  search).  As  a 
consequence,  we  are  exploring  an  auditory-spatial  variant  of  the  Sternberg 
task  used  In  the  context  of  various  maneuvers  on  the  GAT  2  general  aviation 
simulator. 
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COMPARISON  OF  WORKLOAD  ASSESSMENT  PROCEDURES 
IN  A  DRIVING  SIMULATOR 

Five  methods  of  measuring  mental  workload  (secondary  task  performance, 
visual  occlusion,  cardiac  arrhythmia,  subjective  opinion  rating  scales,  and 
primary  task  performance)  were  compared  for  sensitivity  to  changes  in  opera¬ 
tor  loading.  Each  was  used  to  differentiate  among  low,  medium,  and  high 
levels  of  workload  defined  in  terms  of  the  application  point  of  cross-wind 
gusts  in  a  driving  task. 

The  driving  task  was  produced  using  an  automobile  driving  simulator  with  a 
six-degree-of-freedom  computer  generated  display,  a  4-degree  of  freedom 
physical  motion  system,  and  a  four-channel  sound  system.  Techniques  of 
mental  workload  measurement  that  have  shown  promise  in  previous  studies  were 
used  as  a  between-subjects  factor,  and  subjects  were  presented  with  a 
wi thin-subject  factor  of  wind  gust  placement.  Gusts  at  the  front  of  the 
vehicle  represented  high  workload  levels,  and  gusts  toward  the  center  of  the 
vehicle  represented  progressively  lower  levels  of  workload. 

The  results  showed  significant  differences  among  workload  levels  for  subjec¬ 
tive  opinion  scales  and  primary  performance  measures  of  lateral  deviation, 
yaw  deviation,  and  steering  reversals.  A  relative  sensitivity  estimate  of 
these  would  be  from  highest  to  lowest  sensitivity,  steering  reversals  and 
yaw  deviation,  rating  scales,  and  lateral  deviation.  The  techniques  of 
occlusion,  cardiac  arrhythmia,  and  secondary  task  performance  yielded  no 
significant  workload  effect. 

MEASUREMENT  OF  PSYCHOMOTOR  WORKLOAD  IN  SIMULATOR 
DRIVING  BY  A  SECONDARY  TASK- SUBSEQUENT  COMPARISON  OF 
PRIMARY  AND  SECONDARY  TASK  MEASURES  OF  WORKLOAD 

Six  subjects  drove  a  simulated  vehicle  with  normal  automobile  handling  and 
another  six  drove  with  degraded  handling  (slow  response).  Steering  ratio 
and  disturbance  level  were  adjusted  within  each  set  of  six  subjects.  A 
secondary  task  consisting  of  reading  random  digits  aloud  from  a  single-digit 
dashboard  display  was  used  to  assess  workload.  Using  a  technique  similar  to 
that  of  Knowles  (1963)  and  McDonald  (1973),  it  was  found  that  workload 
increased  significantly  as  disturbance  level  Increased.  Furthermore,  work¬ 
load  increased  significantly  with  degraded  vehicle  handling.  In  contrast, 
increasing  steering  ratio  did  not  produce  a  significant  change  In  workload. 
These  results  Indicate  that  secondary  task  method  can  be  used  to  assess  the 
major  effects  of  simulated  vehicle  handling  on  driver  workload.  Problems 
remain,  however,  in  designing  more  sensitive  secondary  task  measures. 


Because  the  secondary  task  measure  appeared  less  sensitive  than  desired, 
driving  performance  measures  recorded  during  the  same  experiment  were  later 
analyzed.  Particular  emphasis  In  examining  the  driving  performance  data  was 
placed  on  (1)  determining  the  degree  of  Intrusion  of  the  secondary  task  on 
the  driving  task  as  a  function  of  the  Independent  variables,  and  (2)  on 
comparing  the  sensitivity  of  the  primary  and  secondary  task  measures.  The 
results  showed  the  secondary  task  does  not  intrude  significantly  upon  the 
driving  task  performance  at  low  workload  levels,  but  that  It  does  signifi¬ 
cantly  Intrude  at  high  workload  levels.  Also,  when  the  four  primary  task 
measures  were  analyzed  for  sensitivity  to  the  Independent  variables,  new 
Information  was  obtained  Indicating  greater  sensitivity  than  Is  obtained 
with  the  single  secondary  task  measure.  Steering  ratio,  for  example.  Is 
found  to  affect  performance  at  high  disturbance  levels— a  result  not 
obtained  In  examining  the  secondary  task  by  Itself.  The  merits  of  primary 
and  secondary  task  performance  analysis  are  discussed,  and  suggestions  are 
made  for  future  work. 

SURVEY  AND  ANALYSIS  OF  OPERATOR  WORKLOAD  TECHNIQUES 

Over  400  references  relating  to  operator  mental  workload  were  selected  and 
classified  according  to  a  two-dimensional  scheme  Including  workload  method¬ 
ology  and  universal  operator  behavior.  Twenty-eight  specific  techniques  of 
assessing  workload  by  means  of  subjective  opinions,  spare  mental  capacity, 
primary  task,  and  physiological  measures  were  cataloged.  The  catalog  sum¬ 
marizes  critical  criteria  that  need  to  be  considered  In  the  flight  test  and 
evaluation  environments  and  describes  each  technique  In  terms  of  theory  and 
background,  description  of  necessary  method/apparatus,  area  of  application 
and  example,  limitations,  and  suggested  RDT&E  follow  ups. 

AN  ANNOTATED  BIBLIOGRAPHY  OF  650  WORKLOAD  DOCUMENTS 

An  annotated  bibliography  on  operator  mental  workload  was  developed  with 
supporting  Information.  This  bibliography  was  based  upon  two  literature 
searches,  one  performed  In  1977  in  support  of  a  survey  and  analysis  catalog 
(AD  A059-501)  and  one  performed  in  1979  as  an  update. 

Each  literature  search  citation  presented  contains  reference  Information,  an 
abstract,  a  numerical  workload  technique  category  classification,  a  numeri¬ 
cal  operator  behavior  classification,  and  a  group  of  word  descriptors. 
Workload  methods  are  divided  Into  28  specific  techniques  In  four  major  cate¬ 
gories:  opinion,  spare  mental  capacity,  primary  task,  and  physiological. 
Applicable  operator  behaviors  are  similarly  divided  Into  categories. 

The  descriptors  associated  with  each  citation  designate  the  general  workload 
classification,  the  specific  workload  classification,  the  type  of  presenta¬ 
tion,  the  type  of  facilities  used,  and  the  potential  aircrew  application. 
Over  600  citations  are  presented.  Two  Indexes  are  also  provided.  The  first 
Is  a  workload  technique  Index  and  the  second  Is  an  experimental  facility 
Index.  It  Is  concluded  that  periodic  updating  of  the  bibliography  will  be 
required  and  that  attention  should  be  directed  toward  computerizing  fiiture 
workload  bibliographies. 


COMPARATIVE  EVALUATION  OF  VARIOUS  MEASURES 
TAKEN  FROM  A  SINGLE  SECONDARY  TASK 


Problems  have  been  encountered  In  previous  research  In  developing  a  second¬ 
ary  task  measure  of  mental  workload  that  Is  both  sensitive  and  stable. 
Ordinarily  a  single  measure  of  secondary  task  Is  analyzed  as  «n  Indicator  of 
difference  In  workload.  The  purpose  of  this  project  was  to  determine 
whether  alternate  measures  taken  from  a  single  secondary  task  might  prove 
more  sensitive.  Twelve  subjects  participated  In  the  experiment  Involving  a 
primary  task  (meter  pointer  nulling)  and  a  secondary  task  (reading  random 
digits  aloud).  The  Independent  variable  (primary  task  difficulty  level)  was 
adjusted  by  changing  the  number  of  meters  that  had  to  be  monitored  (2,  3,  or 
4  meters).  Dependent  measures  were  taken  on  the  (1)  number  of  random  digits 
spoken  (usual  workload  formula),  (2)  longest  Interval  between  spoken 
responses,  (3)  longest  consecutive  string  of  spoken  digits,  and  (4)  the 
number  of  "triplets"  spoken.  Results  show  that  the  dependent  measures  (1), 
(3),  and  (4)  were  significant  with  (1)  being  the  most  sensitive. 

COMPARATIVE  EVALUATION  OF  THE  SENSITIVITY, 

TRANSFERABILITY,  AND  INTRUSION  OF  A  VARIETY  OF 
WORKLOAD  ESTIMATION  TECHNIQUES  IN  AIRCREW  TASKS 

The  purpose  of  our  present  work,  sponsored  by  NASA-Ames,  Is  to  examine  the 
sensitivity.  Intrusion,  and  transferability  of  a  variety  of  workload  assess¬ 
ment  techniques.  The  study  will  use  four  different  simulated  piloting 
tasks,  emphasizing  psychomotor,  perceptual,  medlatlonal,  and  communications 
aspects.  Pilot  loading  levels  wll  be  systematically  adjusted.  Our  simula¬ 
tion  facility  Is  a  GAT-lb  that  has  been  modified  and  Instrumented  for  work¬ 
load  estimation  techniques  measurement.  The  flight  simulator  Itself  has 
3  degrees  of  physical  motion  and  a  full  complement  of  IFR  Instruments. 

Recently  we  completed  the  experiment  emphasizing  the  psychomotor  aspect  of 
flight.  Instrument-rated  pilots  flew  Instrument  approaches  under  three 
combined  settings  of  the  Independent  variable:  Increasing  turbulence  and 
decreasing  longitudinal  stability.  Twenty  different  workload  measures  were 
taken  between  the  outer  and  middle  markers,  only  five  of  which  showed  sta¬ 
tistically  reliable  changes  as  a  function  of  the  Independent  variable. 
Included  In  the  five  were  two  rating  scales,  one  measure  of  control  Input 
activity,  heart  rate,  and  one  measure  of  time  estimation.  The  results  of 
the  experiment  are  to  some  extent  surprising,  for  they  Indicate  that  several 
"accepted"  measures  of  workload  are  not  reliably  sensitive  to  the  k'ds  of 
psyehomotor  load  which  pilots  encounter. 

We  are  currently  planning  the  perceptual  and  medlatlonal  (cognitive)  experi¬ 
ments.  In  both  cases  pilots  will  fly  the  simulator  In  the  simple  task  of 
maintaining  heading,  airspeed,  and  altitude.  For  the  perceptual  task,  they 
will  also  perform  a  forced-pace  visual  search  task  presented  through  the 
windscreen  using  an  Ektagraphlc  display.  The  complexity  of  the  search  task 
will  become  the  Independent  variable.  The  medlatlonal  task,  navigation 
problems  will  be  presented.  The  problems  will  be  forced  pace,  but  will  not 
require  computational  aids.  We  expect  to  have  the  results  of  these  two 
experiments  In  the  spring  of  1982. 


Wilson,  Glenn  F. 

Department  of  Psychology 
Wittenberg  University 
Springfield,  Ohio  45501 
Ph.  (513)  317-7421 

STEADY-STATE  EVOKED  RESPONSE 

Steady-state  evoked  responses  (ER)  are  being  tested  as  to  their  utility  as  a 
measure  of  mental  workload.  Several  cognitive  and  motor  tasks  are  being 
used  which  each  have  two  or  three  levels  of  difficulty.  ER  measures  of 
phase  lag  and  amplitude  recovered  during  the  time  subjects  engage  the 
various  tasks  are  correlated  with  the  level  of  difficulty.  High  frequency 
(40  to  60  Hz)  flicker  Is  being  used  to  elicit  the  ERs;  these  have  the  advan¬ 
tage  of  being  close  to  fusion  frequency  and  thereby  relatively  unobtrusive 
into  the  primary  task. 

TRANSIENT- EVOKED  RESPONSE 

Transient-evoked  responses  are  being  used  to  assess  pilots'  responses  to 
emergency  situations  In  a  motion-based  simulator.  Single-trial  evoked 
responses  in  response  to  auditory  tones  are  used  to  determine  whether  or  not 
the  pilot  recognized  the  onset  of  the  emergency  situation  in  time  to  take 
corrective  actions.  Eye  movement  analysis  is  also  being  used  to  study 
point-of-regard  during  these  episodes. 
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SECTION  IV 


WORKLOAD  LABORATORIES 

This  section  is  a  listing  of  laboratories  and  research  groups  engaged  in 
programmatic  research  on  mental  workload.  The  entries  are  arranged  alpha- 
betlcally  by  laboratory  name.  A  mailing  address  Is  provided  and  the  labora¬ 
tory  director  as  well  as  other  personnel  are  identified.  In  addition, 
entries  may  Include  a  brief  description  of  the  laboratory's  research 
Interests  and  goals. 
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AFAMRL  WORKLOAD  AND  ERGONOMICS  BRANCH 


AFAMRL/HEG 

Wright-Patterson  AFB,  Ohio  45433 

Col.  Robert  D.  O'Donnell 

Mr.  Gary  Reid,  Mr.  William  Pearson, 

Dr.  Clark  Shingledecker,  and  Dr.  G.  Wilson 

The  lab  is  dedicated  to  developing  and  implementing  workload  assessment 
techniques  for  specific  application  to  Air  Force  systems.  Separate  labora¬ 
tories  are  involved  in  development  of  behavioral /performance  measures  and 
neuropsychological/physiological  measures.  The  laboratory  mandate  Involves 
conducting  studies  in-house,  contractual  efforts,  and  validation  studies  in 
simulators  and  field  units.  In  addition,  workload  standards  for  all  Air 
Force  systems  will  be  generated  and  MIL-Specs  for  acceptable  workload  will 
be  produced  by  CY85. 

APPLIED  PSYCHOLOGICAL  SERVICES 


404  East  Lancaster  Avenue 
Wayne,  Pennsylvania  19087 

A.  Siegel 

P.  Federman,  R.  Leahy,  M.  Pfeiffer,  F.  Kopsteln,  and  N.  Madden 

The  work  emphasizes  methods  for  measuring  intellective  load  and  assessing 
the  effects  of  overload  on  performance.  A  factorial  approach  is  taken. 

BAC  CREW  SYSTEMS  (2-3755) 

P.0.  Box  3999,  M.S.  82-87 
Seattle,  Washington  98124 

Mr.  W.  U.  Hebenstrelt 

Dieter  W.  Jahns,  Judl  Qualy,  George  Boucek,  and  Charles  A.  Anderson 

Develop  workload  assessment/prediction  methodology  for  commercial  and 
military  aircraft  operability  certification.  Investigate  the  utility  and 
sensitivity  of  various  human  performance  and  physiological  parameters  for 
scaling  operator  workload  In  realistic  crew/alrcraft/misslon  contexts.  Both 
analytical  and  crew-1 n-the-loop  simulation  techniques  are  used. 
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CENTER  FOR  WORK  SAFETY  AND  HUMAN  ENGINEERING 


Industrial  and  Management  Engineering 
Technion,  Haifa,  Israel 

Dr.  Daniel  Gopher 

Dr.  David  Navon  and  Dr.  Peretz  Lavic 
CENTER  FOR  APPLIED  PSYCHOLOGICAL  STUDIES 


Old  Dominion  University 
Norfolk,  Virginia  23508 

Dr.  Ben  B.  Morgan,  Jr. 

Dr.  Glynn  D.  Coates,  Mr.  Peter  S.  Winne, 

Mr.  Michael  Secunda,  and  Dr.  Raymond  H.  Kirby 

Conduct  research  dealing  with  the  assessment  and  enhancement  of  human 
performance  in  man-machine  systems.  These  efforts  are  directed  generally 
toward  improving  systems  efficiency  by  increasing  the  understanding  of  basic 
capabilities  of  the  human  component  in  the  system  and  the  factors— including 
workload— that  influence  these  capabilities.  We  are  particularly  concerned 
with  the  effects  of  temporal,  biological,  and  environmental  stressors  on 
human  performance  Individual  differences  in  performance  capabilities  and 
responses  to  stress  and  complex  skill  acquisition,  retention,  and  mainte¬ 
nance.  Much  of  our  research  is  conducted  with  the  multiple-task  methodology 
of  the  synthetic  work  approach  to  performance  assessment.  This  methodology 
routinely  involves  the  assessment  of  performance  at  different  levels  of 
workload. 

CREWSTATION  DESIGN  FACILITY 
ASD/ENECH 

Wright-Patterson  AFB,  Ohio  45433 
Richard  Gel sel hart 

Larry  Ivey,  David  Gunning,  Capt.  Mike  Manning,  and  Jan  Gavern 

The  Crewstation  Design  Facility  is  equipped  with  three  full  mission  flight 
simulators:  an  A-10,  a  FB-111,  and  a  KC-135.  The  simulators  are  used  to 
conduct  applied  human  factors  research  in  support  of  various  system  program 
offices  (SPOs)  at  Wright-Patterson.  The  research  problems  cover  a  wide 
range  of  topics  such  as  crewstation  layout,  control /display  design,  automa¬ 
tion,  terrain  following,  air-to-ground  attack,  display  symbology,  etc. 
Although  the  facility  Is  not  dedicated  to  developing  new  workload  measure¬ 
ment  techniques,  workload  Is  almost  always  a  major  concern  In  the  research 
efforts.  The  facility  personnel  are  continuously  applying  different  work¬ 
load  measurement  techniques  in  the  various  research  projects. 
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'  AD  -  A 1 22  428  REGISTER  OF  RESEARCH  IN  PROGRESS  ON  MENTAL  WORKLOAD(U) 
AIR  FORCE  AEROSPACE  MEDICAL  RESEARCH  LAB 
WRIGHT -PATTERSON  AFB  OH  T  R  METZLER  ET  AL .  JUL  82 
UNCLASSIFIED  AFAMRL-TR-82-42  F/G  5/9 


CREW  SYSTEMS  ENGINEERING  GROUP 
AFWAL/FIGR 

Wright- Patterson  AFB,  Ohio  45433 
Richard  Moss 

Larry  Butterbaugh,  Evelyn  Blanch,  and  Lt.  Dan  Basehore 

The  Crew  Systems  Engineering  Group  has  the  objective  of  providing  crewsta- 
tlon  design  guidelines  and  preliminary  crew  procedures  for  candidate  air¬ 
craft.  This  technology  Includes  developing  a  physical  representation  of  the 
cockpit  design  to  Include  control -display  formats  and  workspace  layout.  The 
mission  scenario  Is  analyzed  In  terms  of  necessary  systems  and  associated 
crew  tasks,  and  these  are  systematically  arranged  over  time  to  provide  an 
accurate  task  time  line  with  which  to  evaluate  the  design  effort.  Designs 
are  Iterated  and  evaluated  with  Increasing  fidelity  from  mockup  through 
dynamic  pi lot- In- the- loop  simulation.  The  process  carries  through  to  estab¬ 
lishing  the  technology  tradeoffs  between  crew  size/workload  and  avionics 
automation/sophistication.  The  Group  Is  also  responsible  for  such  func¬ 
tional  areas  as  crew  workload  measurement  and  problem  analysis  for  current 
as  well  as  future  aircraft  and  major  systems. 

COCKPIT  INFORMATION  SYSTEMS— WORKLOAD  ASSESSMENT 


NASA-Ames  Research  Center 
Mall  Stop  239-2 

Moffett  Field,  California  94035 
Sandra  G.  Hart 

Kathleen  Bird,  Laura  Lapp,  Mike  Bortoluccl, 

David  Suzuki,  and  Cheryl  Chapel 

The  global  purpose  Is  to  develop  a  methodology  for  measuring  pilot  workload 
In  simulation  and  In-flight  research.  The  Immediate  aim  Is  to  develop  sub¬ 
jective  rating  scales,  primary  performance  measures,  and  possibly  unobtru¬ 
sive  secondary  measures,  to  use  In  evaluating  the  Impact  of  cockpit  displays 
of  traffic  Information  on  pilot  and  controller  workload.  In  providing  these 
measures,  theoretical  research  will  be  supported,  and  more  general  applica¬ 
tions  will  be  developed.  The  hope  Is  that  by  stepping  back,  redefining  the 
problem,  and  starting  back  with  the  pilot  and  looking  at  what  he  does, 
thinks,  and  feels  and  relating  this  to  what  he  says  (and  what  we  measure) 
about  his  workload,  we  can  make  some  headway.  Simply  trying  more  secondary 
tasks  or  wiring  up  subjects  for  more  physiological  output  Isn't  the  solu¬ 
tion.  The  reason  that  the  different  subjective,  objective,  and  physiologi¬ 
cal  measures  correlate  with  each  other  so  poorly  Is  that  each  one  most 
likely  taps  a  different  aspect  of  the  subjective  experience  of  workload- 
some  focusing  on  task  demands,  some  on  performance,  some  on  stress  and 
physical  effort,  some  on  perception,  others  on  cognition,  etc.— and  most 
rely  on  the  task  requirements  as  a  definition  of  load  and  performance  as  a 
definition  of  effort.  Neither  may  be  correct  or  valid. 
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CYBERLAB 


Department  of  EE  and  CS 
University  of  Connecticut 
Box  U-157 

Storrs,  Connecticut  06268 
Professor  D.  L.  Klelnman 
Professor  A.  R.  Ephrath 

CYBERLAB  Mas  established  In  1976  to  provide  an  administrative  and  academic 
framework  for  the  conduct  of  specialized  theoretic  and  empirical  research  In 
the  field  of  systems  In  general  and.  In  particular,  systems  that  Include 
humans  as  components.  The  laboratory  conducts  analytical  and  experimental 
research  on  human  performance  In  manual  control  and  decision-making  tasks. 

DUNLAP  AND  ASSOCIATES,  IRC. 

920  Kline  Street,  Suite  203 
La  Jolla,  California  92037 

Clyde  A.  Brlctson,  Ph.D. 

Anthony  P.  Clavarelll,  N.A. 

ENGINEERING-PSYCHOLOGY  LABORATORY 


Department  of  Psychology 
University  of  Illinois 
Champaign,  Illinois  61820 

Christopher  Wlckens 

William  Derrick,  John  Mlclllzl,  Diane  Sandry,  and  Roger  Marsh 

The  Engineering-Psychology  Laboratory  Is  an  Interdisciplinary  facility 
operated  jointly  by  the  Department  of  Psychology  and  Mechanlcal/Industrlal 
Engineering.  The  Laboratory  contains  a  GAT  2  general  aviation  simulator  and 
three  general  purpose  experimental  computers,  along  with  speech  recognition 
and  synthesis  devices.  It  Is  devoted  to  research  in  basic  Issues  of  human 
performance,  particularly  as  these  pertain  to  aviation.  Primary  research 
activities  relate  to  workload,  divided  attention,  failure  detection,  and 
fault  diagnosis. 
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FAA  CIVIL  AERONEDICAL  INSTITUTE.  AVIATION  PSYCHOLOGY  LABORATORY. 

HOMAN  PEftFOftHANCTUNlT -  - - 

FAA-CAHI,  AAC-118 
P.0.  Box  25082 

Oklahoma  City,  Oklahoma  73125 
Henry  W.  Mertens,  Ph.D. 

Nelda  J.  Sapp 

GENERAL  PHYSICS  CORPORATION 

1  Northgate  Park 
Chattanooga ,  Tennessee  37415 

Ed  Kozlnstey 

Jullen  M.  Christensen 

HUMAN  FACTORS  LABORATORY 

University  of  South  Dakota 
Vermillion,  South  Dakota  57069 

LCDR  Helm 

J.  Stone 

Scaling  Mental  Workload  using  category  versus  ratio  scaling  techniques. 

HUMAN  FACTORS  TEST  AND  EVALUATION  METHODLOGY  DEVELOPMENT  LABORATORY 

Naval  Air  Test  Center 
Mall  Code  SY721 

Patuxent  River,  Maryland  20670 
Dr.  Sam  Schlflett 

Dr.  Carole  Bohn,  Cdr.  Harv  Gregolre,  Ph.D.,  Mr.  Dick  Malchll, 

Mr.  Art  Weaver,  Mr.  Gave  Intano,  Mr.  Keith  Karn,  and  Mr.  Gary  Lolklth 

HUMAN  PERFORMANCE  LABORATORY 

Engineering- Psycho logy  Department 
McDonnell  Douglas  Corporation 
St.  Louis,  Missouri  63166 

Dr.  Frank  Gomer 

Dr.  Larry  R.  Beldeman,  Dr.  William  Cody,  and  Dr.  Klrmach  Natanl 
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HUNAN  PERFORMANCE  RESEARCH  LABORATORY 

Dr.  Jerrold  N.  Levine 

INSTITUT  FUR  ARBEITSWISSENSCHAFT 

Petersens tr.  30, 

6100  Darmstadt 

Federal  Republic  of  Germany 

Prof.  Dr.-Ing.  Vi.  Rohmert 

Dr.  E.  Haider,  Dlpl.-Ing.  R.  Helblg,  and  Dr.  P.  Jenlk 

Basic  research  Is  done  to  validate  physiological  measures  or  In  order  to 
concentrate  on  Isolated  workload  factors. 

INSTITUTE  FOR  EXPERIMENTAL  PSYCHOLOGY 

Kerklaan  30,  Haren 
The  Netherlands,  G751NN 

Dr.  G.  Mulder 

Dr.  L.  S.  Mulder,  Dts.  R.  A.  Brookhuls,  Dts.  H.  Veldman,  D.  T.  S.  Bakker 

The  primary  task  of  the  Institute  Is  to  train  students  In  Experimental 
Psychology.  The  research  lines  of  the  Institute  are: 

1.  Research  In  Cognitive  Skills 

2  Psychophysiology  of  Mental  Tasks 

3.  Applied  Research  (Psychological  and  Physiological  Aspects  of 
Driving;  Psychopharmacology) 

MAN-MACHINE  SYSTEMS  GROUP 

Electronics  Department 
RISO  National  Laboratory 
DK-4000  Roskllde 
Denmark 

Jens  Rasmussen  (plus  five  coworkers) 

INTRODUCTION 

This  group  Is  concerned  with  design  and  operational  problems  with  safety  and 
reliability  In  modem  process  plant.  These  have  to  do  particularly  with  the 
distribution  of  tasks  related  to  system  protection  between  operations  per¬ 
sonnel  and  the  plant  Instrumentation  and  control  system  as  well  as  estab¬ 
lishing  means  for  Including  the  human  In  systematic  reliability  and  risk 
analyses. 
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MAW- MACH I HE  SYSTEMS  LAB 
Room  1-110  MIT 

Cambridge ,  Massachusetts  02139 

Prof.  T.  B.  Sheridan 

R.  W.  Simpson,  W.  Wood,  and  J.  Tzelgov 

Academic  research  laboratory  staffed  by  graduate  students,  visiting 
scientists,  and  faculty.  Devoted  to  experiments  and  modeling  of  man-machine 
interaction  In  ocean  systems,  robotics,  nuclear  power,  and  process  control. 

MENTAL  PROCESSES  LABORATORY/ PSYCHOPHYSIOLOGY  LAB— EEG/E06 

Human  Factors  Engineering 
Douglas  Aircraft  Company 
Cl-253,  Code  35-36 
3855  Lakewood  Boulevard 
Long  Beach,  California  90846 

R.  F.  Gabriel,  Ph.D. 

Robert  T.  White,  Ph.D.  and  Michael  A.  Blferno,  Ph.D. 

The  Mental  Processes  Laboratory  Is  dedicated  to  research  on  mental  workload. 
Of  particular  Interest  are  the  Identification  of  mental  processes  that  con¬ 
tribute  most  to  cockpit  workload;  the  quantification  and  meaurement  of  men¬ 
tal  workload  components;  and  the  development  of  guidelines  and  criteria  for 
the  design  of  Information  displays  that  will  minimize  mental  workload.  The 
laboratory  Is  directed  and  staffed  by  the  Human  Factors  Engineering  group. 
In  addition  to  on-going  research,  the  laboratory  Investigates  specific  men¬ 
tal  workload  problems  referred  by  design  groups  and  constantly  endeavors  to 
bridge  the  gap  between  basic  and  applied  research.  Both  behavioral  and 
physiological  measures  are  being  Investigated. 

MRC  APPLIED  PSYCHOLOGY  UNIT 


15  Chaucer  Road 
Cambridge  CB22EF,  England 

Dr.  I.  D.  Brown 

Dr.  D.  G.  Wastell  and  Dr.  P.  McLeod 

Theoretical  and  applied  research  on  normal  human  characteristics  and 
performance,  In  order  to  advise  governmental  and  other  organizations  on  the 
design  of  work,  tasks,  and  equipment. 
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NASA  LANGLEY  RESEARCH  CENTER 


Flight  Dynamics  and  Control  Division 
Hampton,  Vlrgnla  23665 

Randall  L.  Harris,  Sr. 

Dr.  Alan  Pope,  Amos  Spadey,  and  Marvin  Waller 

Primary  Interest  Is  to  apply  oculometer  type  data  and  pilot  screening  data 
with  the  pilot's  screening  data  analysis  technique  to  evaluate  mental  work¬ 
load.  Derived  measures  from  Information  theory,  cabled  Entropy  Rate,  Is 
also  being  used  to  validate  these  measured  for  mental  workload.  Currently 
one  of  the  projects  that  Is  being  used  to  help  In  this  evaluation  Is  a  com¬ 
parison  of  a  Vertical  Speed  Indicator  (versus  the  conventional  dial  type 
VSI). 

NAVAL  BIODYNAMICS  LAB 
Box  29407 

New  Orleans,  Louisiana  70189 
Dr.  Channlng  L.  Ewing 

Drs.  Thomas,  Gulgnard,  Ewing,  Kennedy,  Shannon,  Bittner,  and  Carter 

The  effects  of  Inertial  forces  on  human  responses.  Inertial  forces  on  all 
linear  and  angular  acceleration.  Human  response— everything  from  skeletal 
to  thinking  and  decision  making. 

OPERATIONS  TRAINING  DIVISION 

AFHRL/OT 

Williams  AFB,  Arizona 
Col.  Needhorn 

Dr.  Thomas  Longrldge,  Dr.  J.  C.  DeMalo, 

Dr.  Ernest  Buckland,  and  Dr.  Ronald  Hughes 

PERFORMANCE  ASSESSMENT  LABORATORY 


Old  Dominion  University 
Norfolk,  Virginia  23508 

Dr.  Ben  B.  Morgan,  Jr. 

Dr.  61ynn  D.  Coates,  Dr.  Raymond  H.  Kirby,  and  Mr.  Peter  S.  Wlnne 

The  Performance  Assessment  Laboratory  conducts  research  dealing  with  the 
assessment  and  enhancement  of  human  performance  In  man-machine  systems, 
particularly  In  Industrial  and  military  settings.  Falling  broadly  within 
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the  dona In  of  Human  Factors  and  Engineering  Psychology*  these  efforts  are 
directed  toward  Improving  systems  efficiency  by  Increasing  the  understanding 
of  basic  capabilities  of  the  human  component  In  the  system  and  the  factors 
that  Influence  these  capabilities. 

Illustrative  Problem  Areas: 

e  Effects  of  temporal,  biological,  and  environmental  stressors  on 
human  performance . 

e  Synthetic  work  methodology  In  performance  assessment. 

e  Psychomotor,  perceptual,  and  Information-processing  capabilities 

of  the  human  operator. 

e  Individual  differences  In  performance  capabilities  and  responses  to 
stressors. 

e  Performance  effects  of  circadian  rhythms  and  menstrual  cycles. 

e  Effectiveness  of  team  training  techniques. 

e  Skill  acquisition  and  maintenance. 

PSYCHOLOGY  DIVISION.  INSTITUTE  FOR  PERCEPTION 

Institute  for  Perception, 

TNO  Soerterberg,  The  Netherlands 

Prof.  Dr.  A.  E.  Sanders 

Dr.  A.  H.  K.  Gall  lard.  Dr.  P.Joma,  and  Dr.  H.  H.  Janssen 

Interest  In  simultaneous  performance  of  more  than  one  task.  Interest  In 
electrophyslologlcal  measures  of  mental  load.  Both  Interests  are  material¬ 
ized  In  basic  laboratory  tests  as  well  as  In  applied  settings  like  diving 
and  automobile  driving. 

PTI-UNIT.  UNIVERSITY  OF  STOCKHOLM 

Box  5602,  SU4  86 
Stockholm,  Sweden 

Gunner  Borg 

The  general  Interest  of  the  group  concerns  theories  and  methods  In  scaling 
subjective  effort  and  difficulty,  performance  measures  of  the  same  varia¬ 
bles,  and  their  physiological  correlates.  The  theoretical  and  methodologi¬ 
cal  Interest  Is  then  combined  with  various  applications  In  medicine,  preven¬ 
tive  activities,  and  rehabilitation  In  Industries  and  In  sports.  New  psycho¬ 
physical  methods  are  developed  especially  for  quantitative  evaluations  of 
subjective  Intensity  but  also  for  qualitative  aspects  and  dimension 
analysis. 


98 


RAF  INSTITUTE  OF  AVIATIOH  MEDICINE 

Farnborough,  Hampshire 
United  Kingdom  6U14  6SZ 

V.  David  Hopkln 

R.  M.  Ray! or,  A.  McClumpha,  J.  V.  F.  Berman, 
and  C.  S.  Narborough-Hal 1 

The  psychologists  In  the  General  Psychology  Section  of  the  Royal  Air  Force 
Institute  of  Aviation  Medicine  are  concerned  with  the  application  of  practi¬ 
cal  human  factors  knowledge,  obtained  from  the  literature  and  from  their  own 
research,  to  solve  aviation  problems  In  the  air  and  on  the  ground.  A  cur¬ 
rent  Interest  Is  the  relationship  between  recent  developments  In  cognitive 
psychology  and  practical  problems,  particularly  of  information  processing, 
attention,  memory,  mental  workload,  and  capacity.  Human  capabilities  and 
limitations  are  related  to  task  objectives,  the  physical  environment  In 
which  the  task  has  to  be  done,  the  standards  to  be  achieved,  the  selection 
and  training  required,  and  technological  developments.  Current  topics  of 
Interest  Include  air  traffic  control  systems,  aviation  maps,  cockpit  ergo¬ 
nomics,  the  effects  on  cognitive  processing  of  minor  departures  from  optimum 
physical  environments,  the  etiology  of  errors,  and  the  roles  of  man  In 
highly  automated  systems.  Although  many  practical  problems  require  a  short¬ 
term  answer,  longer-term  studies  which  give  continuity  to  the  work  are  also 
conducted. 

SYSTEMS  RESEARCH  LABORATORIES.  INC.  (SRL) 

Human  Factors  Engineering  Division 
2800  Indian  ripple  Road 
Dayton,  Ohio  45440 

Dr.  Norman  R.  Potter 

M.  S.  Crabtree,  Dr.  F.  T.  Eggemeler,  0.  C.  Simons,  Dr.  J.  S.  Skelly 

SRL  Is  active  In  all  three  major  areas  of  workload  assessment— behavioral , 
physiological,  and  subjective.  Staff  experience  Includes  a  broad  range  of 
Army,  Air  Force,  and  Navy  projects  requiring  workload  assessment  In  applied 
settings  as  well  as  the  development  of  workload  metrics  In  both  the  field 
and  the  laboratory.  SRL  engineers  and  programmers  design  and  build  many 
types  of  systems  for  physiological  recordings,  presentations  of  primary  end 
secondary  tasks,  and  recording  of  human  operator  performance  data. 
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SYSTEMS  TECHNOLOGY,  INC. 

13766  South  Hawthorne  Boulevard 
Hawthorne,  California  90402 

Henry  R.  Jex 

D.  T.  McRuer,  1.  L.  Ashkenas,  R.  W.  Allen,  W.  F.  Clement, 

R.  K.  Heffley,  R.  A.  Peters,  and  W.  F.  Jewell 

Operator  control  strategy,  workload,  and  human  error  measurement  by 
Intrusive  and  nonlntruslve  methods. 

INTRUSIVE  APPROACHES 

Cross-adaptive  task  measure  of  excess  control  capacity  based  on  cross- 
coupled  Instability  using  existing  Inputs/describing  function  analysis  by 
finite  Fourier  transformation  using  Injected  test  inputs;  eye  point  of 
regard. 

NONINTRUSIVE  APPROACHES 

Samples  data  correlation  In  time  domain  or  phase  plane  using  lease  squares 
criterion  with  existing  Inputs  and  eye  point  of  regard. 

CONTROL  STRATEGY  MODELS 

Metacontroller  based  on  successive  organization  of  perception  (SOP)  theory. 
Including  Isomorphic  models  for  compensatory,  pursuit,  and  precognitlve 
strategies  and  algorithmic  models  for  the  SOP  and  monitoring  processes. 

PERCEPTUAL  MOTOR  WORKLOAD  MODELS 

Excess  control  capacity,  properties  of  describing  functions,  remnant,  eye 
point  of  regard  distributions. 

USARTI  AEROMECHANICS  LABORATORY  FLIGHT  CONTROL  DIVISION 

human'  ncrmwm - 


Director,  U.S.  Army  Aeromechanics  Laboratory 
DAVDL-AL-C 

207-5  Ames  Research  Center 
Moffett  Field,  California  94035 

Attention:  David  Key 

Dr,  Edward  M.  Huff 

Dr.  Robert  H.  Wright 

The  Aeromechanics  Laboratory  sponsors  a  man-machine  Integration  research 
activity  jointly  with  the  NASA  Ames  Research  Center's  Hell copter/ VTOL  Human 
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Factors  Office.  Applied  research  on  helicopter  man-machine  Integration 
topics  focuses  on  Improved  system  design  methods*  concepts*  and  evaluations. 
The  main  areas  of  effort  are  helicopter  pilot  workload  and  performance* 
research  flight  simulation  methods  and  requirements,  helicopter  control*  and 
display  technology. 

VEHICLE  SIMULATION  LABORATORY 

155  Hhlttemore  Hall 
VPI  &  SU 

Blacksburg,  Virginia  24061 
Halter  W.  Hlerwllle 

Sidney  Connor,  John  G.  Casall,  and  Mans  Rahlml 

The  general  thrust  of  our  present  workload  research  Is  In  experimental 
validation  of  a  variety  of  workload  estimation  techniques.  Vehicular 
environments  are  simulated  and  techniques  are  then  examined.  He  are  also 
working  on  refined  rating  scales  and  methods  for  examining  short-term 
workload. 

HORKLOAD  RESEARCH  GROUP 


Decisions  and  Designs,  Inc. 

Suite  600,  8400  Hestpark  Drive 
McLean,  Virginia  22101 

Michael  L.  Donnell,  Ph.D. 

John  F.  Patteron,  Ph.D.,  Michael  F.  O'Conner,  Ph.D.,  and 
Clinton  H.  Kelly,  Ph.D. 

To  understand,  measure,  and  predict  mental  and/or  physical  workload  as  a 
function  of  the  characteristics  of  various  types  of  tasks  and  man-machine 
Interfaces.  Emphasis  Is  on  applied  as  opposed  to  basic  research;  mental  as 
opposed  to  physical  workload;  subjective  as  opposed  to  performance  measures. 
Metric  development  and  scaling  are  emphasized  as  part  of  the  development  of 
analytical  workload  estimation  techniques.  Primary  applications  to  date 
have  dealt  with  Naval  aircraft,  submarines,  and  other  weapons  systems.  A 
key  concept  focusing  the  group's  activities  has  been  system  effective  opera¬ 
bility*  which  Is  viewed  as  a  function  of  task  criticality,  workload,  and 
system  technical  effectiveness. 
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WORKLOAD  RESEARCH  6RQUP 

23766  South  Hawthorne  Boulevard 
Hawthorne,  California  90402 

Hr.  Henry  R.  Jex 

R.  Wade  Allen,  James  C.  Smith,  Warren  A.  Clement,  Anthony  C.  Stein, 
and  Richard  A.  Peters 

One  or  more  members  of  this  group,  with  assistance  from  various  staff 
members,  act  as  team  leader/members  on  basic  and  applied  workload  measure* 
ment  projects.  Members  are  two -thirds  engineers  and  one-third  engineer- 
psychologists.  Interests  cover  experimental  methodology,  model  development/ 
validation,  device  development  (e.g.,  the  well  known  S.  T.  I.  Critical 
Instability  Task)  and  application  to  man/machine  problems  (e.g.,  displays, 
controls,  drugs— the  effects  of  environmental,  task,  and  operator  variables 
on  workload). 
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SECTION  V 

POTENTIAL  FUNDING  SOURCES 

This  section  was  compiled  from  responses  to  a  request  for  the  names  and 
addresses  of  organizations  which  have  interests  in  mental  workload  problems 
and  which  may  be  sources  of  funding  for  relevant  research.  It  should  be 
noted  that  these  entries  reflect  the  opinions  of  the  respondents  and  were 
not  necessarily  obtained  after  consultation  with  a  listed  organization. 
Therefore,  It  is  suggested  that  these  entries  be  used  only  as  a  general 
guide  to  Initiating  inquiries  about  research  funding. 
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This  section  Is  a  bibliography  compiled  from  responses  to  a  request  to  list 
those  journal  articles,  books,  reports,  and  conference  proceedings  which.  In 
the  opinion  of  the  researcher,  have  made  the  greatest  contributions  to  the 
understanding  of  mental  workload. 
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